2021-01-28T03:46:55.213 INFO:root:teuthology version: 1.0.0-f185165d 2021-01-28T03:46:55.216 DEBUG:teuthology.run:Teuthology command: teuthology --name kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi --owner scheduled_kchai@teuthology --archive /home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834184 --verbose --lock --description rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} --block -- /tmp/teuthology-worker.5xueli01.tmp 2021-01-28T03:46:55.242 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-28T03:46:55.306 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834184 branch: wip-kefu-testing-2021-01-27-1353 description: rados/cephadm/with-work/{distro/ubuntu_20.04 fixed-2 mode/root mon_election/classic msgr/async start tasks/rados_python} email: tchaikov@gmail.com first_in_suite: false job_id: '5834184' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-kefu-testing-2021-01-27-1353 ceph: conf: global: mon election default strategy: 1 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 osd shutdown pgref assert: true log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - but it is still running - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(PG_ - \(OSD_ - \(OBJECT_ - \(POOL_APP_NOT_ENABLED\) log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 507028cb839c25d6666833702df6325fd8569096 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 cephadm: cephadm_mode: root install: ceph: sha1: 507028cb839c25d6666833702df6325fd8569096 workunit: branch: wip-kefu-testing-2021-01-27-1353 sha1: 507028cb839c25d6666833702df6325fd8569096 owner: scheduled_kchai@teuthology priority: 70 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - ceph.rgw.realm.zone.a - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b - ceph.iscsi.iscsi.a sha1: 507028cb839c25d6666833702df6325fd8569096 sleep_before_teardown: 0 suite: rados suite_branch: wip-kefu-testing-2021-01-27-1353 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 507028cb839c25d6666833702df6325fd8569096 tasks: - install: null - cephadm: conf: mgr: debug mgr: 20 debug ms: 1 - workunit: clients: client.0: - rados/test_python.sh teuthology_branch: master timestamp: 2021-01-28_03:28:19 tube: smithi user: kchai verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.6139 2021-01-28T03:46:55.306 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa; will attempt to use it 2021-01-28T03:46:55.310 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-kefu-testing-2021-01-27-1353/qa/tasks 2021-01-28T03:46:55.311 INFO:teuthology.run_tasks:Running task internal.check_packages... 2021-01-28T03:46:55.312 INFO:teuthology.task.internal:Checking packages... 2021-01-28T03:46:55.366 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'basic' and ceph hash '507028cb839c25d6666833702df6325fd8569096' 2021-01-28T03:46:55.366 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2021-01-28T03:46:55.367 INFO:teuthology.packaging:ref: None 2021-01-28T03:46:55.367 INFO:teuthology.packaging:tag: None 2021-01-28T03:46:55.367 INFO:teuthology.packaging:branch: wip-kefu-testing-2021-01-27-1353 2021-01-28T03:46:55.367 INFO:teuthology.packaging:sha1: 507028cb839c25d6666833702df6325fd8569096 2021-01-28T03:46:55.368 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-kefu-testing-2021-01-27-1353 2021-01-28T03:46:55.547 INFO:teuthology.task.internal:Found packages for ceph version 17.0.0-184-g507028cb-1focal 2021-01-28T03:46:55.548 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2021-01-28T03:46:55.559 INFO:teuthology.task.internal:no buildpackages task found 2021-01-28T03:46:55.559 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2021-01-28T03:46:55.574 INFO:teuthology.lock.ops:Locking machines... 2021-01-28T03:46:55.575 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-28T03:46:55.624 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-28T03:47:05.647 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-28T03:47:15.665 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-28T03:47:25.684 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-28T03:47:35.699 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 1)... 2021-01-28T03:47:45.726 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:47:58.652 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:48:08.671 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:48:18.693 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:48:28.712 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:48:38.731 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:48:48.750 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:48:58.767 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:49:08.784 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:49:18.803 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:49:28.819 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:49:38.841 INFO:teuthology.lock.ops:waiting for more smithi machines to be free (need 0 + 2, have 0)... 2021-01-28T03:49:48.859 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_kchai@teuthology', 'count': 2, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834184'} 2021-01-28T03:49:48.879 DEBUG:teuthology.lock.ops:locked ubuntu@smithi150.front.sepia.ceph.com, ubuntu@smithi134.front.sepia.ceph.com 2021-01-28T03:49:48.941 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3263ae0ea0>, signals=[15]) 2021-01-28T03:49:48.945 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi150.front.sepia.ceph.com' reimaging 2021-01-28T03:49:48.946 INFO:teuthology.lock.ops:Updating [ubuntu@smithi150.front.sepia.ceph.com]: reset os type and version on server 2021-01-28T03:49:48.946 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2021-01-28T03:49:48.964 INFO:teuthology.lock.ops:Node 'ubuntu@smithi150.front.sepia.ceph.com' reimaging is complete 2021-01-28T03:49:48.964 INFO:teuthology.lock.ops:Start node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging 2021-01-28T03:49:48.965 INFO:teuthology.lock.ops:Updating [ubuntu@smithi134.front.sepia.ceph.com]: reset os type and version on server 2021-01-28T03:49:48.965 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-01-28T03:49:48.981 INFO:teuthology.lock.ops:Node 'ubuntu@smithi134.front.sepia.ceph.com' reimaging is complete 2021-01-28T03:49:49.168 INFO:teuthology.provision.fog.smithi150:Scheduling deploy of ubuntu 20.04 2021-01-28T03:49:49.185 INFO:teuthology.provision.fog.smithi134:Scheduling deploy of ubuntu 20.04 2021-01-28T03:49:49.476 INFO:teuthology.orchestra.console:Power off smithi150 2021-01-28T03:49:49.478 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-28T03:49:49.499 INFO:teuthology.orchestra.console:Power off smithi134 2021-01-28T03:49:49.501 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2021-01-28T03:49:49.512 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:49:49.531 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:49:49.644 INFO:teuthology.orchestra.console:Power off for smithi150 completed 2021-01-28T03:49:49.657 INFO:teuthology.orchestra.console:Power off for smithi134 completed 2021-01-28T03:49:49.746 INFO:teuthology.orchestra.console:Power on smithi150 2021-01-28T03:49:49.746 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-28T03:49:49.759 INFO:teuthology.orchestra.console:Power on smithi134 2021-01-28T03:49:49.760 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2021-01-28T03:49:49.769 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:49:49.782 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:49:53.802 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:49:53.814 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:49:57.918 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi150.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:49:57.928 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2021-01-28T03:49:58.130 INFO:teuthology.orchestra.console:Power on for smithi150 completed 2021-01-28T03:49:58.139 INFO:teuthology.orchestra.console:Power on for smithi134 completed 2021-01-28T03:49:58.232 INFO:teuthology.provision.fog.smithi150:Waiting for deploy to finish 2021-01-28T03:49:58.240 INFO:teuthology.provision.fog.smithi134:Waiting for deploy to finish 2021-01-28T03:52:59.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:08.535 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:14.576 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:17.592 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:23.636 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:26.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:32.692 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:35.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:41.753 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:44.788 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:50.836 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:53.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:53:59.891 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:02.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:08.951 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:18.011 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:27.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:36.310 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:42.315 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:48.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:54.329 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:54:55.412 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:01.417 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:07.424 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:07.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:07.620 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-28T03:55:07.622 DEBUG:teuthology.orchestra.run.smithi134:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-28T03:55:08.078 INFO:teuthology.provision.fog.smithi134:Node is ready 2021-01-28T03:55:08.079 DEBUG:teuthology.orchestra.run.smithi134:> hostname 2021-01-28T03:55:08.084 INFO:teuthology.orchestra.run.smithi134.stdout:smithi134.front.sepia.ceph.com 2021-01-28T03:55:08.085 DEBUG:teuthology.orchestra.run.smithi134:> grep smithi134.front.sepia.ceph.com /etc/hosts 2021-01-28T03:55:08.091 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.15.134 smithi134.front.sepia.ceph.com smithi134 2021-01-28T03:55:08.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2021-01-28T03:55:08.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hosts 2021-01-28T03:55:08.206 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/172.21.15.134/172.21.15.134/g' /etc/hosts 2021-01-28T03:55:08.218 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i -e 's/smithi134.front.sepia.ceph.com/smithi134/g' /etc/hostname 2021-01-28T03:55:08.276 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname smithi134 2021-01-28T03:55:08.286 INFO:teuthology.provision.fog.smithi134:Deploy complete! 2021-01-28T03:55:08.287 DEBUG:teuthology.parallel:result is None 2021-01-28T03:55:13.430 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:19.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:19.574 INFO:teuthology.orchestra.run:Running command with timeout 600 2021-01-28T03:55:19.575 DEBUG:teuthology.orchestra.run.smithi150:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2021-01-28T03:55:20.150 INFO:teuthology.provision.fog.smithi150:Node is ready 2021-01-28T03:55:20.150 DEBUG:teuthology.orchestra.run.smithi150:> hostname 2021-01-28T03:55:20.157 INFO:teuthology.orchestra.run.smithi150.stdout:smithi150.front.sepia.ceph.com 2021-01-28T03:55:20.157 DEBUG:teuthology.orchestra.run.smithi150:> grep smithi150.front.sepia.ceph.com /etc/hosts 2021-01-28T03:55:20.163 INFO:teuthology.orchestra.run.smithi150.stdout:172.21.15.150 smithi150.front.sepia.ceph.com smithi150 2021-01-28T03:55:20.164 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2021-01-28T03:55:20.312 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hosts 2021-01-28T03:55:20.328 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/172.21.15.150/172.21.15.150/g' /etc/hosts 2021-01-28T03:55:20.345 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i -e 's/smithi150.front.sepia.ceph.com/smithi150/g' /etc/hostname 2021-01-28T03:55:20.404 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname smithi150 2021-01-28T03:55:20.414 INFO:teuthology.provision.fog.smithi150:Deploy complete! 2021-01-28T03:55:20.414 DEBUG:teuthology.parallel:result is None 2021-01-28T03:55:20.576 INFO:teuthology.lock.ops:Checking smithi150.front.sepia.ceph.com 2021-01-28T03:55:20.577 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-28T03:55:20.594 INFO:teuthology.lock.ops:Checking smithi134.front.sepia.ceph.com 2021-01-28T03:55:20.595 INFO:teuthology.lock.ops:New key found. Updating... 2021-01-28T03:55:20.623 INFO:teuthology.lock.ops:Updating [smithi150.front.sepia.ceph.com]: set os type and version on server 2021-01-28T03:55:20.624 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:55:20.625 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:20.693 DEBUG:teuthology.orchestra.run.smithi150:> true 2021-01-28T03:55:20.820 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2021-01-28T03:55:20.827 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2021-01-28T03:55:20.827 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2021-01-28T03:55:20.832 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu" 2021-01-28T03:55:20.832 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-28T03:55:20.832 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu 2021-01-28T03:55:20.833 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian 2021-01-28T03:55:20.833 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-28T03:55:20.833 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="20.04" 2021-01-28T03:55:20.833 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-28T03:55:20.834 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-28T03:55:20.834 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-28T03:55:20.834 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-28T03:55:20.834 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=focal 2021-01-28T03:55:20.834 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=focal 2021-01-28T03:55:20.835 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2021-01-28T03:55:20.850 INFO:teuthology.lock.ops:Updating [smithi134.front.sepia.ceph.com]: set os type and version on server 2021-01-28T03:55:20.851 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:55:20.851 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:20.905 DEBUG:teuthology.orchestra.run.smithi134:> true 2021-01-28T03:55:21.163 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2021-01-28T03:55:21.171 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2021-01-28T03:55:21.172 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2021-01-28T03:55:21.221 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2021-01-28T03:55:21.222 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-28T03:55:21.222 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2021-01-28T03:55:21.222 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2021-01-28T03:55:21.222 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-28T03:55:21.222 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="20.04" 2021-01-28T03:55:21.223 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-28T03:55:21.223 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-28T03:55:21.223 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-28T03:55:21.223 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-28T03:55:21.223 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=focal 2021-01-28T03:55:21.224 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=focal 2021-01-28T03:55:21.224 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-01-28T03:55:21.240 INFO:teuthology.lock.ops:2 smithi machines locked this try, 2/2 locked so far 2021-01-28T03:55:21.277 INFO:teuthology.lock.ops:Locked targets: smithi134.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCqndipdU+WjE6b1MI7E1GsPERLPkZOdddV36j4+abK2xKZIHp8q9IUwfDBfgZTgndYbfXS+MEMARBy9yifgDXCTO0g3ldWBBf4ZdZyD6oGN7u8NgbP2Nsff32vwuzUWgSluDQ3vUqBnYDTQHDXoNK4lT22L3RSOCER64ZvRAAKpvzAWo9pTnXlm0ODAHgItUu2DCkqEPyJbeh+834L1j+z5f1gwgWA6TBFH84/nqGl4iqxmJuHqyBd4AmzlxRC+/AyZyiGN2JQ0HvWU4xSqGDDZIKNSWCsdBBehi38ZYZ0VgVt7Lk20h5gno72HPW8XavMEq6GtzgXb6nJzchMx1RzRb4dPVVfKkvsbrFHXVy4ZA/hGSi7J/Xpqn6UHcH0/4GPeoI5PtGYZyBD9Kv5oafZnS+nd0QZIp6FJWSBoT8+1mLarz97YzXsaIbQWxj0FHdxiUM/H7/ofMZye2ceqrbgtBo026xKYC48N4JfSYPlxLwjk9fwjevSlfARIzO/knk= smithi150.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDPJ1JQREaxkbAA5E3DsHImIPSgsAUdWJrCGdu1pF6AEZ40A15TTvE01SB41D4KsbUy24tzEmOI4n3c1fFH7a2KRyhwR7FOS0yhNfsZaWSuAHTNWJad/IlTNuTAGV1kX4nE3sRCdoFPFG8X9MBb6dPMtFj4G/tbBJu6bLzr5Ox0w3hUPJdqCHblx7CUXfBEMod2bE+ml3MvfGK3XKVkkOenH+rQ7C/ASZdDRqC/cdunIKeCp2Gsu/L1vJ3By+pbJDAJwfxGxL3o46pRGxWX9WgQ4/3Ugc+A26b8VFSnIIfJPygd750YB+HGM3DjASFphBieAbqJ3e/11/0XYG+6h00Bto2BKYvCUCHQ4Yb1IX2BoCGkJxLsERlVy571+v6StlZaLk9EQqOxzqy5lkv25HU1DZp8TCpEo6Y/p+Y0G6SaEtD5dFsfi+eL3dyUrV6GN6NlEcyOVifzafBtGSSNvVDFz8KjOqQFkv+rqofl6oifLw8S53Ba7KUTCQ14bwzZjhc= 2021-01-28T03:55:21.278 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2021-01-28T03:55:21.330 INFO:teuthology.run_tasks:Running task internal.save_config... 2021-01-28T03:55:21.335 INFO:teuthology.task.internal:Saving configuration 2021-01-28T03:55:21.352 INFO:teuthology.run_tasks:Running task internal.check_lock... 2021-01-28T03:55:21.362 INFO:teuthology.task.internal.check_lock:Checking locks... 2021-01-28T03:55:21.384 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-28 03:49:48.866148', 'description': '/home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834184', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIFYLfUjIm4v5frv2MAvNX86Z2socF109hKpCp2Mxp7r/', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi150.front.sepia.ceph.com'} 2021-01-28T03:55:21.402 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2021-01-28 03:49:48.866178', 'description': '/home/teuthworker/archive/kchai-2021-01-28_03:28:19-rados-wip-kefu-testing-2021-01-27-1353-distro-basic-smithi/5834184', 'locked_by': 'scheduled_kchai@teuthology', 'up': True, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIP5257pBRUpTdOEaaMAJ2cyU8+kT63SE9rHc5lJzhSwv', 'os_version': '20.04', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'ubuntu', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi134.front.sepia.ceph.com'} 2021-01-28T03:55:21.402 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2021-01-28T03:55:21.413 INFO:teuthology.task.internal:roles: ubuntu@smithi150.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'ceph.rgw.realm.zone.a', 'node-exporter.a', 'alertmanager.a'] 2021-01-28T03:55:21.414 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b', 'ceph.iscsi.iscsi.a'] 2021-01-28T03:55:21.415 INFO:teuthology.run_tasks:Running task console_log... 2021-01-28T03:55:21.484 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f32675e80d0>, signals=[15]) 2021-01-28T03:55:21.486 INFO:teuthology.run_tasks:Running task internal.connect... 2021-01-28T03:55:21.493 INFO:teuthology.task.internal:Opening connections... 2021-01-28T03:55:21.494 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi150.front.sepia.ceph.com 2021-01-28T03:55:21.496 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:21.546 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2021-01-28T03:55:21.548 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:55:21.601 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2021-01-28T03:55:21.610 DEBUG:teuthology.orchestra.run.smithi150:> uname -m 2021-01-28T03:55:21.616 INFO:teuthology.orchestra.run.smithi150.stdout:x86_64 2021-01-28T03:55:21.617 DEBUG:teuthology.orchestra.run.smithi150:> cat /etc/os-release 2021-01-28T03:55:21.666 INFO:teuthology.orchestra.run.smithi150.stdout:NAME="Ubuntu" 2021-01-28T03:55:21.666 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-28T03:55:21.666 INFO:teuthology.orchestra.run.smithi150.stdout:ID=ubuntu 2021-01-28T03:55:21.666 INFO:teuthology.orchestra.run.smithi150.stdout:ID_LIKE=debian 2021-01-28T03:55:21.667 INFO:teuthology.orchestra.run.smithi150.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-28T03:55:21.667 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_ID="20.04" 2021-01-28T03:55:21.667 INFO:teuthology.orchestra.run.smithi150.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-28T03:55:21.667 INFO:teuthology.orchestra.run.smithi150.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-28T03:55:21.668 INFO:teuthology.orchestra.run.smithi150.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-28T03:55:21.668 INFO:teuthology.orchestra.run.smithi150.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-28T03:55:21.668 INFO:teuthology.orchestra.run.smithi150.stdout:VERSION_CODENAME=focal 2021-01-28T03:55:21.668 INFO:teuthology.orchestra.run.smithi150.stdout:UBUNTU_CODENAME=focal 2021-01-28T03:55:21.669 INFO:teuthology.lock.ops:Updating smithi150.front.sepia.ceph.com on lock server 2021-01-28T03:55:21.685 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2021-01-28T03:55:21.692 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2021-01-28T03:55:21.692 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2021-01-28T03:55:21.741 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Ubuntu" 2021-01-28T03:55:21.742 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="20.04.1 LTS (Focal Fossa)" 2021-01-28T03:55:21.742 INFO:teuthology.orchestra.run.smithi134.stdout:ID=ubuntu 2021-01-28T03:55:21.742 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE=debian 2021-01-28T03:55:21.742 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Ubuntu 20.04.1 LTS" 2021-01-28T03:55:21.743 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="20.04" 2021-01-28T03:55:21.743 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.ubuntu.com/" 2021-01-28T03:55:21.743 INFO:teuthology.orchestra.run.smithi134.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2021-01-28T03:55:21.743 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2021-01-28T03:55:21.744 INFO:teuthology.orchestra.run.smithi134.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2021-01-28T03:55:21.744 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_CODENAME=focal 2021-01-28T03:55:21.744 INFO:teuthology.orchestra.run.smithi134.stdout:UBUNTU_CODENAME=focal 2021-01-28T03:55:21.745 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2021-01-28T03:55:21.761 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2021-01-28T03:55:21.809 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2021-01-28T03:55:21.817 INFO:teuthology.task.internal:Checking for old test directory... 2021-01-28T03:55:21.818 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2021-01-28T03:55:21.821 DEBUG:teuthology.orchestra.run.smithi150:> test '!' -e /home/ubuntu/cephtest 2021-01-28T03:55:21.832 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2021-01-28T03:55:21.840 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2021-01-28T03:55:21.840 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2021-01-28T03:55:21.844 DEBUG:teuthology.orchestra.run.smithi150:> test -z $(ls -A /var/lib/ceph) 2021-01-28T03:55:21.892 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2021-01-28T03:55:21.937 INFO:teuthology.run_tasks:Running task kernel... 2021-01-28T03:55:21.955 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.c': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}, 'osd.3': {'kdb': True, 'sha1': 'distro'}, 'client.0': {'kdb': True, 'sha1': 'distro'}, 'ceph.rgw.realm.zone.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.a': {'kdb': True, 'sha1': 'distro'}, 'alertmanager.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}, 'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'osd.4': {'kdb': True, 'sha1': 'distro'}, 'osd.5': {'kdb': True, 'sha1': 'distro'}, 'osd.6': {'kdb': True, 'sha1': 'distro'}, 'osd.7': {'kdb': True, 'sha1': 'distro'}, 'client.1': {'kdb': True, 'sha1': 'distro'}, 'prometheus.a': {'kdb': True, 'sha1': 'distro'}, 'grafana.a': {'kdb': True, 'sha1': 'distro'}, 'node-exporter.b': {'kdb': True, 'sha1': 'distro'}, 'ceph.iscsi.iscsi.a': {'kdb': True, 'sha1': 'distro'}} 2021-01-28T03:55:21.956 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2021-01-28T03:55:21.956 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2021-01-28T03:55:21.963 INFO:teuthology.orchestra.run.smithi150.stdout:5.4.0-64-generic 2021-01-28T03:55:21.964 INFO:teuthology.task.kernel:Running kernel on smithi150: 5.4.0-64-generic 2021-01-28T03:55:21.964 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2021-01-28T03:55:22.259 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2021-01-28T03:55:22.650 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:55:22.651 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-28T03:55:22.668 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-28T03:55:22.996 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-28T03:55:23.136 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [180 kB] 2021-01-28T03:55:23.262 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [789 kB] 2021-01-28T03:55:23.333 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [474 kB] 2021-01-28T03:55:23.450 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [104 kB] 2021-01-28T03:55:23.469 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [6,144 B] 2021-01-28T03:55:23.469 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-28T03:55:23.490 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-28T03:55:23.490 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [532 kB] 2021-01-28T03:55:23.532 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-28T03:55:23.539 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [420 kB] 2021-01-28T03:55:23.557 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [191 kB] 2021-01-28T03:55:23.568 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-28T03:55:23.569 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [142 kB] 2021-01-28T03:55:23.575 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [73.9 kB] 2021-01-28T03:55:23.577 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.2 kB] 2021-01-28T03:55:23.577 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,728 B] 2021-01-28T03:55:23.578 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-28T03:55:23.645 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-28T03:55:23.673 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-28T03:55:23.677 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-28T03:55:23.677 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-28T03:55:23.678 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-28T03:55:23.718 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-28T03:55:27.614 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 5,293 kB in 2s (3,251 kB/s) 2021-01-28T03:55:28.640 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2021-01-28T03:55:28.661 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-28T03:55:28.728 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2021-01-28T03:55:28.879 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2021-01-28T03:55:28.880 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2021-01-28T03:55:28.955 INFO:teuthology.orchestra.run.smithi150.stderr:E: Unable to locate package linux-image-current-generic 2021-01-28T03:55:28.957 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-28T03:55:28.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-28T03:55:29.027 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2021-01-28T03:55:29.178 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2021-01-28T03:55:29.217 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2021-01-28T03:55:29.305 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2021-01-28T03:55:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-28T03:55:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-28T03:55:29.306 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-28T03:55:29.307 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2021-01-28T03:55:29.307 INFO:teuthology.orchestra.run.smithi150.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-28T03:55:29.308 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2021-01-28T03:55:29.308 INFO:teuthology.orchestra.run.smithi150.stdout: thermald 2021-01-28T03:55:29.335 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2021-01-28T03:55:29.335 INFO:teuthology.orchestra.run.smithi150.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-28T03:55:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-28T03:55:29.336 INFO:teuthology.orchestra.run.smithi150.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-28T03:55:29.336 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2021-01-28T03:55:29.337 INFO:teuthology.orchestra.run.smithi150.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-28T03:55:29.509 INFO:teuthology.orchestra.run.smithi150.stdout:3 upgraded, 5 newly installed, 0 to remove and 21 not upgraded. 2021-01-28T03:55:29.510 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 74.1 MB of archives. 2021-01-28T03:55:29.510 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-28T03:55:29.511 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-28T03:55:30.596 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-28T03:55:30.841 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-28T03:55:32.076 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-28T03:55:32.076 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-28T03:55:32.077 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-28T03:55:32.416 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-28T03:55:32.434 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-28T03:55:32.896 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 74.1 MB in 3s (24.0 MB/s) 2021-01-28T03:55:33.080 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-28T03:55:35.038 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-28T03:55:35.043 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:55:35.132 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:36.949 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-28T03:55:36.967 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:55:37.078 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:38.069 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-28T03:55:38.084 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:55:38.127 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:42.617 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:55:42.741 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:55:43.085 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:55:43.212 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:55:43.724 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-28T03:55:43.739 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-28T03:55:43.972 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-28T03:55:49.554 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-28T03:55:49.578 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:55:49.621 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:52.192 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:55:52.318 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:55:52.688 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-28T03:55:52.814 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:53.958 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:54.092 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-28T03:55:54.218 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:55.273 INFO:teuthology.orchestra.run.smithi150.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-28T03:55:55.273 INFO:teuthology.orchestra.run.smithi150.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-28T03:55:55.420 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:56.531 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-28T03:55:56.673 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-28T03:55:56.809 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:55:56.999 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-28T03:55:57.000 INFO:teuthology.orchestra.run.smithi150.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:56:18.321 INFO:teuthology.orchestra.run.smithi150.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-28T03:56:18.321 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub' 2021-01-28T03:56:18.336 INFO:teuthology.orchestra.run.smithi150.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-28T03:56:18.363 INFO:teuthology.orchestra.run.smithi150.stdout:Generating grub configuration file ... 2021-01-28T03:56:18.700 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-28T03:56:18.730 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:56:19.166 INFO:teuthology.orchestra.run.smithi150.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-28T03:56:19.178 INFO:teuthology.orchestra.run.smithi150.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-28T03:56:21.927 INFO:teuthology.orchestra.run.smithi150.stdout:done 2021-01-28T03:56:22.280 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2021-01-28T03:56:22.313 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2021-01-28T03:56:22.314 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2021-01-28T03:56:22.314 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2021-01-28T03:56:22.315 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2021-01-28T03:56:22.315 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 18 2021-01-28T03:56:22.316 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2021-01-28T03:56:22.316 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2021-01-28T03:56:22.317 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2021-01-28T03:56:22.317 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.4.0.65.68 2021-01-28T03:56:22.317 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-28T03:56:22.317 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-28T03:56:22.317 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2021-01-28T03:56:22.318 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2021-01-28T03:56:22.318 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2021-01-28T03:56:22.318 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2021-01-28T03:56:22.319 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-28T03:56:22.319 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2021-01-28T03:56:22.327 INFO:teuthology.orchestra.run.smithi134.stdout:5.4.0-64-generic 2021-01-28T03:56:22.328 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.4.0-64-generic 2021-01-28T03:56:22.328 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2021-01-28T03:56:22.514 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2021-01-28T03:56:22.807 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:56:22.807 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [109 kB] 2021-01-28T03:56:22.868 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2021-01-28T03:56:23.190 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [101 kB] 2021-01-28T03:56:23.264 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [474 kB] 2021-01-28T03:56:23.412 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [413 kB] 2021-01-28T03:56:23.540 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [180 kB] 2021-01-28T03:56:23.555 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [104 kB] 2021-01-28T03:56:23.566 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [6,144 B] 2021-01-28T03:56:23.566 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [118 kB] 2021-01-28T03:56:23.569 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [17.4 kB] 2021-01-28T03:56:23.570 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [420 kB] 2021-01-28T03:56:23.607 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [789 kB] 2021-01-28T03:56:23.645 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [532 kB] 2021-01-28T03:56:23.684 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [73.9 kB] 2021-01-28T03:56:23.689 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [9,728 B] 2021-01-28T03:56:23.713 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [191 kB] 2021-01-28T03:56:23.736 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [11.7 kB] 2021-01-28T03:56:23.737 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [142 kB] 2021-01-28T03:56:23.750 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [21.2 kB] 2021-01-28T03:56:23.751 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [545 kB] 2021-01-28T03:56:23.781 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [735 kB] 2021-01-28T03:56:23.823 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [149 kB] 2021-01-28T03:56:23.830 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [15.5 kB] 2021-01-28T03:56:23.830 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [16.9 kB] 2021-01-28T03:56:23.831 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [4,992 B] 2021-01-28T03:56:23.872 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [536 B] 2021-01-28T03:56:26.646 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 5,293 kB in 1s (3,619 kB/s) 2021-01-28T03:56:27.682 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2021-01-28T03:56:27.702 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-28T03:56:27.766 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2021-01-28T03:56:27.917 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2021-01-28T03:56:27.918 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2021-01-28T03:56:27.988 INFO:teuthology.orchestra.run.smithi134.stderr:E: Unable to locate package linux-image-current-generic 2021-01-28T03:56:27.990 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-28T03:56:27.991 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-28T03:56:28.053 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2021-01-28T03:56:28.188 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2021-01-28T03:56:28.188 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2021-01-28T03:56:28.310 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2021-01-28T03:56:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-28T03:56:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-generic linux-image-5.4.0-65-generic 2021-01-28T03:56:28.311 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-5.4.0-65-generic linux-modules-extra-5.4.0-65-generic 2021-01-28T03:56:28.312 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2021-01-28T03:56:28.312 INFO:teuthology.orchestra.run.smithi134.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2021-01-28T03:56:28.313 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2021-01-28T03:56:28.313 INFO:teuthology.orchestra.run.smithi134.stdout: thermald 2021-01-28T03:56:28.340 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2021-01-28T03:56:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: linux-headers-5.4.0-65 linux-headers-5.4.0-65-generic 2021-01-28T03:56:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: linux-image-5.4.0-65-generic linux-modules-5.4.0-65-generic 2021-01-28T03:56:28.341 INFO:teuthology.orchestra.run.smithi134.stdout: linux-modules-extra-5.4.0-65-generic 2021-01-28T03:56:28.342 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2021-01-28T03:56:28.342 INFO:teuthology.orchestra.run.smithi134.stdout: linux-generic linux-headers-generic linux-image-generic 2021-01-28T03:56:28.513 INFO:teuthology.orchestra.run.smithi134.stdout:3 upgraded, 5 newly installed, 0 to remove and 21 not upgraded. 2021-01-28T03:56:28.514 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 74.1 MB of archives. 2021-01-28T03:56:28.514 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 360 MB of additional disk space will be used. 2021-01-28T03:56:28.514 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-65-generic amd64 5.4.0-65.73 [14.5 MB] 2021-01-28T03:56:29.521 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-65-generic amd64 5.4.0-65.73 [8,898 kB] 2021-01-28T03:56:29.764 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-65-generic amd64 5.4.0-65.73 [38.6 MB] 2021-01-28T03:56:30.941 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.65.68 [1,900 B] 2021-01-28T03:56:30.941 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.65.68 [2,620 B] 2021-01-28T03:56:30.942 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65 all 5.4.0-65.73 [11.0 MB] 2021-01-28T03:56:31.261 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-65-generic amd64 5.4.0-65.73 [1,233 kB] 2021-01-28T03:56:31.279 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.65.68 [2,492 B] 2021-01-28T03:56:31.758 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 74.1 MB in 3s (25.3 MB/s) 2021-01-28T03:56:31.960 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-5.4.0-65-generic. 2021-01-28T03:56:33.866 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 114224 files and directories currently installed.) 2021-01-28T03:56:33.872 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../0-linux-modules-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:56:33.963 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:35.720 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-image-5.4.0-65-generic. 2021-01-28T03:56:35.738 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../1-linux-image-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:56:35.824 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:36.815 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-65-generic. 2021-01-28T03:56:36.829 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:56:36.873 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:41.533 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../3-linux-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:56:41.909 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:56:42.236 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:56:42.368 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-image-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:56:42.690 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.4.0-65. 2021-01-28T03:56:42.707 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../5-linux-headers-5.4.0-65_5.4.0-65.73_all.deb ... 2021-01-28T03:56:42.748 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-28T03:56:48.148 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package linux-headers-5.4.0-65-generic. 2021-01-28T03:56:48.172 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../6-linux-headers-5.4.0-65-generic_5.4.0-65.73_amd64.deb ... 2021-01-28T03:56:48.214 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:50.748 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.65.68_amd64.deb ... 2021-01-28T03:56:50.861 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking linux-headers-generic (5.4.0.65.68) over (5.4.0.64.67) ... 2021-01-28T03:56:51.209 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.4.0-65 (5.4.0-65.73) ... 2021-01-28T03:56:51.332 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:52.468 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:52.586 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-headers-generic (5.4.0.65.68) ... 2021-01-28T03:56:52.712 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:53.767 INFO:teuthology.orchestra.run.smithi134.stdout:I: /boot/vmlinuz is now a symlink to vmlinuz-5.4.0-65-generic 2021-01-28T03:56:53.767 INFO:teuthology.orchestra.run.smithi134.stdout:I: /boot/initrd.img is now a symlink to initrd.img-5.4.0-65-generic 2021-01-28T03:56:53.897 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-modules-extra-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:54.999 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-image-generic (5.4.0.65.68) ... 2021-01-28T03:56:55.125 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up linux-generic (5.4.0.65.68) ... 2021-01-28T03:56:55.285 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for linux-image-5.4.0-65-generic (5.4.0-65.73) ... 2021-01-28T03:56:55.476 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/initramfs-tools: 2021-01-28T03:56:55.477 INFO:teuthology.orchestra.run.smithi134.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:57:16.962 INFO:teuthology.orchestra.run.smithi134.stdout:/etc/kernel/postinst.d/zz-update-grub: 2021-01-28T03:57:16.963 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub' 2021-01-28T03:57:16.974 INFO:teuthology.orchestra.run.smithi134.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-28T03:57:17.037 INFO:teuthology.orchestra.run.smithi134.stdout:Generating grub configuration file ... 2021-01-28T03:57:17.435 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-28T03:57:17.472 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:57:17.898 INFO:teuthology.orchestra.run.smithi134.stdout:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-28T03:57:17.911 INFO:teuthology.orchestra.run.smithi134.stdout:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-28T03:57:20.577 INFO:teuthology.orchestra.run.smithi134.stdout:done 2021-01-28T03:57:20.917 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2021-01-28T03:57:20.950 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2021-01-28T03:57:20.950 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2021-01-28T03:57:20.951 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2021-01-28T03:57:20.951 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2021-01-28T03:57:20.951 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 18 2021-01-28T03:57:20.952 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2021-01-28T03:57:20.952 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2021-01-28T03:57:20.952 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2021-01-28T03:57:20.952 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.4.0.65.68 2021-01-28T03:57:20.953 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-28T03:57:20.953 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-28T03:57:20.953 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2021-01-28T03:57:20.953 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2021-01-28T03:57:20.954 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2021-01-28T03:57:20.954 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2021-01-28T03:57:20.955 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-64-generic Expected: 5.4.0-65-generic 2021-01-28T03:57:20.956 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2021-01-28T03:57:20.956 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-28T03:57:20.956 DEBUG:teuthology.task.kernel:src is distro, skipping download 2021-01-28T03:57:20.957 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2021-01-28T03:57:20.957 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi150.front.sepia.ceph.com, path=None, version=distro) 2021-01-28T03:57:20.958 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get clean 2021-01-28T03:57:21.215 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2021-01-28T03:57:21.473 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:57:21.474 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-28T03:57:21.540 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-28T03:57:21.619 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-28T03:57:22.901 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2021-01-28T03:57:22.921 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-28T03:57:22.987 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2021-01-28T03:57:23.120 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2021-01-28T03:57:23.121 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2021-01-28T03:57:23.192 INFO:teuthology.orchestra.run.smithi150.stderr:E: Unable to locate package linux-image-current-generic 2021-01-28T03:57:23.193 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-28T03:57:23.194 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-28T03:57:23.265 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2021-01-28T03:57:23.419 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2021-01-28T03:57:23.420 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2021-01-28T03:57:23.574 INFO:teuthology.orchestra.run.smithi150.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-28T03:57:23.575 INFO:teuthology.orchestra.run.smithi150.stdout:0 upgraded, 0 newly installed, 0 to remove and 21 not upgraded. 2021-01-28T03:57:23.576 DEBUG:teuthology.orchestra.run.smithi150:> dpkg -s linux-image-generic 2021-01-28T03:57:23.593 INFO:teuthology.orchestra.run.smithi150.stdout:Package: linux-image-generic 2021-01-28T03:57:23.593 INFO:teuthology.orchestra.run.smithi150.stdout:Status: install ok installed 2021-01-28T03:57:23.594 INFO:teuthology.orchestra.run.smithi150.stdout:Priority: optional 2021-01-28T03:57:23.594 INFO:teuthology.orchestra.run.smithi150.stdout:Section: kernel 2021-01-28T03:57:23.594 INFO:teuthology.orchestra.run.smithi150.stdout:Installed-Size: 18 2021-01-28T03:57:23.594 INFO:teuthology.orchestra.run.smithi150.stdout:Maintainer: Ubuntu Kernel Team 2021-01-28T03:57:23.595 INFO:teuthology.orchestra.run.smithi150.stdout:Architecture: amd64 2021-01-28T03:57:23.595 INFO:teuthology.orchestra.run.smithi150.stdout:Source: linux-meta 2021-01-28T03:57:23.595 INFO:teuthology.orchestra.run.smithi150.stdout:Version: 5.4.0.65.68 2021-01-28T03:57:23.595 INFO:teuthology.orchestra.run.smithi150.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-28T03:57:23.596 INFO:teuthology.orchestra.run.smithi150.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-28T03:57:23.596 INFO:teuthology.orchestra.run.smithi150.stdout:Recommends: thermald 2021-01-28T03:57:23.596 INFO:teuthology.orchestra.run.smithi150.stdout:Description: Generic Linux kernel image 2021-01-28T03:57:23.596 INFO:teuthology.orchestra.run.smithi150.stdout: This package will always depend on the latest generic kernel image 2021-01-28T03:57:23.597 INFO:teuthology.orchestra.run.smithi150.stdout: available. 2021-01-28T03:57:23.597 DEBUG:teuthology.orchestra.run.smithi150:> mktemp 2021-01-28T03:57:23.604 INFO:teuthology.orchestra.run.smithi150.stdout:/tmp/tmp.ieo7i4X2oN 2021-01-28T03:57:23.605 DEBUG:teuthology.orchestra.run.smithi150:> sudo cp /boot/grub/grub.cfg /tmp/tmp.ieo7i4X2oN 2021-01-28T03:57:23.619 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0666 /tmp/tmp.ieo7i4X2oN 2021-01-28T03:57:23.724 DEBUG:teuthology.orchestra.remote:smithi150:/tmp/tmp.ieo7i4X2oN is 8KB 2021-01-28T03:57:23.739 DEBUG:teuthology.orchestra.run.smithi150:> rm -fr /tmp/tmp.ieo7i4X2oN 2021-01-28T03:57:23.746 DEBUG:teuthology.orchestra.run.smithi150:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-28T03:57:23.804 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T03:57:23.805 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-28T03:57:23.805 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-28T03:57:23.856 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-28T03:57:23.857 DEBUG:teuthology.orchestra.run.smithi150:> sudo update-grub 2021-01-28T03:57:24.953 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub' 2021-01-28T03:57:24.954 INFO:teuthology.orchestra.run.smithi150.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-28T03:57:24.978 INFO:teuthology.orchestra.run.smithi150.stderr:Generating grub configuration file ... 2021-01-28T03:57:25.226 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-28T03:57:25.238 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:57:25.559 INFO:teuthology.orchestra.run.smithi150.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-28T03:57:25.571 INFO:teuthology.orchestra.run.smithi150.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-28T03:57:27.186 INFO:teuthology.orchestra.run.smithi150.stderr:done 2021-01-28T03:57:27.188 DEBUG:teuthology.orchestra.run.smithi150:> sudo shutdown -r now 2021-01-28T03:57:27.190 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2021-01-28T03:57:27.191 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2021-01-28T03:57:27.191 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get clean 2021-01-28T03:57:27.263 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2021-01-28T03:57:27.404 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-28T03:57:27.509 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T03:57:27.588 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-28T03:57:27.668 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-28T03:57:28.801 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2021-01-28T03:57:28.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-current-generic 2021-01-28T03:57:28.887 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2021-01-28T03:57:29.051 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2021-01-28T03:57:29.052 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2021-01-28T03:57:29.129 INFO:teuthology.orchestra.run.smithi134.stderr:E: Unable to locate package linux-image-current-generic 2021-01-28T03:57:29.130 DEBUG:teuthology.orchestra.run:got remote process result: 100 2021-01-28T03:57:29.131 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2021-01-28T03:57:29.198 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2021-01-28T03:57:29.349 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2021-01-28T03:57:29.350 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2021-01-28T03:57:29.487 INFO:teuthology.orchestra.run.smithi134.stdout:linux-image-generic is already the newest version (5.4.0.65.68). 2021-01-28T03:57:29.488 INFO:teuthology.orchestra.run.smithi134.stdout:0 upgraded, 0 newly installed, 0 to remove and 21 not upgraded. 2021-01-28T03:57:29.489 DEBUG:teuthology.orchestra.run.smithi134:> dpkg -s linux-image-generic 2021-01-28T03:57:29.507 INFO:teuthology.orchestra.run.smithi134.stdout:Package: linux-image-generic 2021-01-28T03:57:29.507 INFO:teuthology.orchestra.run.smithi134.stdout:Status: install ok installed 2021-01-28T03:57:29.507 INFO:teuthology.orchestra.run.smithi134.stdout:Priority: optional 2021-01-28T03:57:29.507 INFO:teuthology.orchestra.run.smithi134.stdout:Section: kernel 2021-01-28T03:57:29.508 INFO:teuthology.orchestra.run.smithi134.stdout:Installed-Size: 18 2021-01-28T03:57:29.508 INFO:teuthology.orchestra.run.smithi134.stdout:Maintainer: Ubuntu Kernel Team 2021-01-28T03:57:29.508 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: amd64 2021-01-28T03:57:29.509 INFO:teuthology.orchestra.run.smithi134.stdout:Source: linux-meta 2021-01-28T03:57:29.509 INFO:teuthology.orchestra.run.smithi134.stdout:Version: 5.4.0.65.68 2021-01-28T03:57:29.509 INFO:teuthology.orchestra.run.smithi134.stdout:Provides: virtualbox-guest-modules (= 6.1.10-dfsg-1~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.5) 2021-01-28T03:57:29.509 INFO:teuthology.orchestra.run.smithi134.stdout:Depends: linux-image-5.4.0-65-generic, linux-modules-extra-5.4.0-65-generic, linux-firmware, intel-microcode, amd64-microcode 2021-01-28T03:57:29.509 INFO:teuthology.orchestra.run.smithi134.stdout:Recommends: thermald 2021-01-28T03:57:29.510 INFO:teuthology.orchestra.run.smithi134.stdout:Description: Generic Linux kernel image 2021-01-28T03:57:29.510 INFO:teuthology.orchestra.run.smithi134.stdout: This package will always depend on the latest generic kernel image 2021-01-28T03:57:29.510 INFO:teuthology.orchestra.run.smithi134.stdout: available. 2021-01-28T03:57:29.511 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2021-01-28T03:57:29.516 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.f04CkzDX7z 2021-01-28T03:57:29.516 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub/grub.cfg /tmp/tmp.f04CkzDX7z 2021-01-28T03:57:29.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.f04CkzDX7z 2021-01-28T03:57:29.622 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.f04CkzDX7z is 8KB 2021-01-28T03:57:29.637 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.f04CkzDX7z 2021-01-28T03:57:29.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2021-01-28T03:57:29.699 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T03:57:29.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/grub.d/01_ceph_kernel 2021-01-28T03:57:29.700 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2021-01-28T03:57:29.754 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-65-generic 2021-01-28T03:57:29.756 DEBUG:teuthology.orchestra.run.smithi134:> sudo update-grub 2021-01-28T03:57:31.045 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub' 2021-01-28T03:57:31.046 INFO:teuthology.orchestra.run.smithi134.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2021-01-28T03:57:31.059 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2021-01-28T03:57:31.376 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-65-generic 2021-01-28T03:57:31.387 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-65-generic 2021-01-28T03:57:31.797 INFO:teuthology.orchestra.run.smithi134.stderr:Found linux image: /boot/vmlinuz-5.4.0-64-generic 2021-01-28T03:57:31.809 INFO:teuthology.orchestra.run.smithi134.stderr:Found initrd image: /boot/initrd.img-5.4.0-64-generic 2021-01-28T03:57:33.417 INFO:teuthology.orchestra.run.smithi134.stderr:done 2021-01-28T03:57:33.419 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2021-01-28T03:58:03.448 INFO:teuthology.misc:Re-opening connections... 2021-01-28T03:58:03.449 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2021-01-28T03:58:03.449 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:58:03.450 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:58:21.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.150 2021-01-28T03:58:21.893 INFO:teuthology.misc:trying to connect to ubuntu@smithi134.front.sepia.ceph.com 2021-01-28T03:58:21.893 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:58:21.894 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:59:21.896 DEBUG:teuthology.orchestra.remote:timed out 2021-01-28T03:59:21.902 DEBUG:teuthology.misc:waited 78.4533154964447 2021-01-28T03:59:22.903 INFO:teuthology.misc:trying to connect to ubuntu@smithi150.front.sepia.ceph.com 2021-01-28T03:59:22.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:59:22.905 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:59:23.234 DEBUG:teuthology.orchestra.run.smithi150:> true 2021-01-28T03:59:23.992 DEBUG:teuthology.misc:waited 80.54346942901611 2021-01-28T03:59:24.994 INFO:teuthology.misc:trying to connect to ubuntu@smithi134.front.sepia.ceph.com 2021-01-28T03:59:24.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T03:59:24.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T03:59:25.100 DEBUG:teuthology.orchestra.run.smithi134:> true 2021-01-28T03:59:25.571 DEBUG:teuthology.misc:waited 82.12175416946411 2021-01-28T03:59:26.571 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2021-01-28T03:59:26.572 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.4.0-65-generic"... 2021-01-28T03:59:26.572 DEBUG:teuthology.orchestra.run.smithi150:> uname -r 2021-01-28T03:59:26.580 INFO:teuthology.orchestra.run.smithi150.stdout:5.4.0-65-generic 2021-01-28T03:59:26.581 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-28T03:59:26.581 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-28T03:59:26.581 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-28T03:59:26.582 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2021-01-28T03:59:26.582 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.4.0-65-generic"... 2021-01-28T03:59:26.582 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2021-01-28T03:59:26.589 INFO:teuthology.orchestra.run.smithi134.stdout:5.4.0-65-generic 2021-01-28T03:59:26.589 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-65-generic vs 5.4.0-65-generic 2021-01-28T03:59:26.590 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2021-01-28T03:59:26.590 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2021-01-28T03:59:27.591 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2021-01-28T03:59:27.592 DEBUG:teuthology.orchestra.run.smithi150:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-28T03:59:27.699 INFO:teuthology.orchestra.run.smithi150.stdout:ttyS1 2021-01-28T03:59:27.734 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2021-01-28T03:59:27.734 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2021-01-28T03:59:27.793 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2021-01-28T03:59:27.826 INFO:teuthology.run_tasks:Running task internal.base... 2021-01-28T03:59:32.779 INFO:teuthology.task.internal:Creating test directory... 2021-01-28T03:59:32.781 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-28T03:59:32.784 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2021-01-28T03:59:32.791 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2021-01-28T03:59:32.802 INFO:teuthology.run_tasks:Running task internal.archive... 2021-01-28T03:59:32.820 INFO:teuthology.task.internal:Creating archive directory... 2021-01-28T03:59:32.821 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-28T03:59:32.827 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2021-01-28T03:59:32.887 INFO:teuthology.run_tasks:Running task internal.coredump... 2021-01-28T03:59:32.905 INFO:teuthology.task.internal:Enabling coredump saving... 2021-01-28T03:59:32.906 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-28T03:59:32.910 DEBUG:teuthology.orchestra.run.smithi150:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2021-01-28T03:59:32.932 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-28T03:59:32.933 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-28T03:59:32.942 INFO:teuthology.orchestra.run.smithi150.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-28T03:59:32.944 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2021-01-28T03:59:32.946 INFO:teuthology.run_tasks:Running task internal.sudo... 2021-01-28T03:59:32.954 INFO:teuthology.task.internal:Configuring sudo... 2021-01-28T03:59:32.954 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-28T03:59:32.957 DEBUG:teuthology.orchestra.run.smithi150:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2021-01-28T03:59:32.974 INFO:teuthology.run_tasks:Running task internal.syslog... 2021-01-28T03:59:32.990 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2021-01-28T03:59:32.991 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-28T03:59:32.994 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2021-01-28T03:59:33.022 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-28T03:59:33.030 DEBUG:teuthology.orchestra.run.smithi150:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-28T03:59:33.034 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T03:59:33.035 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-28T03:59:33.061 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2021-01-28T03:59:33.069 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2021-01-28T03:59:33.077 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T03:59:33.077 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2021-01-28T03:59:33.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2021-01-28T03:59:33.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo service rsyslog restart 2021-01-28T03:59:33.158 INFO:teuthology.run_tasks:Running task internal.timer... 2021-01-28T03:59:33.180 INFO:teuthology.task.internal:Starting timer... 2021-01-28T03:59:33.181 INFO:teuthology.run_tasks:Running task pcp... 2021-01-28T03:59:33.241 INFO:teuthology.run_tasks:Running task selinux... 2021-01-28T03:59:33.255 DEBUG:teuthology.task.selinux:Excluding smithi150: OS 'ubuntu' does not support SELinux 2021-01-28T03:59:33.255 DEBUG:teuthology.task.selinux:Excluding smithi134: OS 'ubuntu' does not support SELinux 2021-01-28T03:59:33.256 DEBUG:teuthology.task.selinux:Getting current SELinux state 2021-01-28T03:59:33.256 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2021-01-28T03:59:33.256 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2021-01-28T03:59:33.256 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2021-01-28T03:59:33.274 DEBUG:teuthology.repo_utils:Setting repo remote to git://git.ceph.com/git/ceph-cm-ansible.git 2021-01-28T03:59:33.292 INFO:teuthology.repo_utils:Fetching master from origin 2021-01-28T03:59:33.500 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to origin/master 2021-01-28T03:59:33.680 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2021-01-28T03:59:33.683 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi150.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2021-01-28T03:59:34.609 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2021-01-28T03:59:36.970 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2021-01-28T03:59:40.067 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2021-01-28T03:59:40.817 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:40 +0000 (0:00:00.169) 0:00:00.169 ****** Thursday 28 January 2021 03:59:40 +0000 (0:00:00.019) 0:00:00.188 ****** 2021-01-28T03:59:42.470 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi150.front.sepia.ceph.com] 2021-01-28T03:59:42.545 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:42 +0000 (0:00:02.421) 0:00:02.609 ****** 2021-01-28T03:59:42.555 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] 2021-01-28T03:59:42.638 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:42 +0000 (0:00:00.092) 0:00:02.702 ****** 2021-01-28T03:59:42.793 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2021-01-28T03:59:42.795 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-28T03:59:42.828 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:42 +0000 (0:00:00.189) 0:00:02.892 ****** 2021-01-28T03:59:42.834 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-28T03:59:42.871 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:42 +0000 (0:00:00.042) 0:00:02.935 ****** 2021-01-28T03:59:43.291 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2021-01-28T03:59:43.292 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-28T03:59:43.331 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:43 +0000 (0:00:00.460) 0:00:03.395 ****** 2021-01-28T03:59:43.359 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"append": false, "changed": true, "comment": "cm,,,", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2021-01-28T03:59:43.361 INFO:teuthology.task.ansible.out: 2021-01-28T03:59:43.400 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:43 +0000 (0:00:00.068) 0:00:03.464 ****** 2021-01-28T03:59:43.721 INFO:teuthology.task.ansible.out: 2021-01-28T03:59:43.722 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Delete the ansible users password.] ******************** changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.074582", "end": "2021-01-28 03:59:43.373402", "rc": 0, "start": "2021-01-28 03:59:43.298820", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-28T03:59:43.757 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:43 +0000 (0:00:00.357) 0:00:03.821 ****** 2021-01-28T03:59:43.764 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["passwd", "-d", "cm"], "delta": "0:00:00.089321", "end": "2021-01-28 03:59:44.078954", "rc": 0, "start": "2021-01-28 03:59:43.989633", "stderr": "", "stderr_lines": [], "stdout": "passwd: password expiry information changed.", "stdout_lines": ["passwd: password expiry information changed."]} 2021-01-28T03:59:43.802 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:43 +0000 (0:00:00.044) 0:00:03.866 ****** 2021-01-28T03:59:44.029 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2021-01-28T03:59:44.031 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T03:59:44.070 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:44 +0000 (0:00:00.267) 0:00:04.134 ****** 2021-01-28T03:59:44.109 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:44 +0000 (0:00:00.038) 0:00:04.173 ****** 2021-01-28T03:59:45.039 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2021-01-28T03:59:45.041 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611806384.1266036-1465212955101/source", "state": "file", "uid": 0} changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611806384.0838845-202184032602128/source", "state": "file", "uid": 0} 2021-01-28T03:59:45.076 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:45 +0000 (0:00:00.967) 0:00:05.140 ****** 2021-01-28T03:59:45.111 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:45 +0000 (0:00:00.034) 0:00:05.175 ****** 2021-01-28T03:59:45.470 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2021-01-28T03:59:45.472 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2021-01-28T03:59:45.473 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2021-01-28T03:59:45.475 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2021-01-28T03:59:45.477 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2021-01-28T03:59:45.621 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2021-01-28T03:59:45.628 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2021-01-28T03:59:45.782 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:45 +0000 (0:00:00.671) 0:00:05.847 ****** 2021-01-28T03:59:45.817 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:45 +0000 (0:00:00.034) 0:00:05.881 ****** 2021-01-28T03:59:46.655 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi134.front.sepia.ceph.com] 2021-01-28T03:59:46.657 INFO:teuthology.task.ansible.out: 2021-01-28T03:59:46.702 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] 2021-01-28T03:59:46.768 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2021-01-28T03:59:46.770 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:46 +0000 (0:00:00.951) 0:00:06.832 ****** 2021-01-28T03:59:46.841 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:46 +0000 (0:00:00.072) 0:00:06.905 ****** 2021-01-28T03:59:47.383 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2021-01-28T03:59:47.385 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.319946", "end": "2021-01-28 03:59:47.339695", "rc": 0, "start": "2021-01-28 03:59:47.019749", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} changed: [smithi134.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.381710", "end": "2021-01-28 03:59:47.339253", "rc": 0, "start": "2021-01-28 03:59:46.957543", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-28T03:59:47.432 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.590) 0:00:07.496 ****** 2021-01-28T03:59:47.470 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.037) 0:00:07.534 ****** 2021-01-28T03:59:47.581 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2021-01-28T03:59:47.583 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.013579", "end": "2021-01-28 03:59:47.239466", "failed_when_result": false, "rc": 0, "start": "2021-01-28 03:59:47.225887", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-28T03:59:47.631 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.161) 0:00:07.695 ****** 2021-01-28T03:59:47.638 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.018646", "end": "2021-01-28 03:59:47.978918", "failed_when_result": false, "rc": 0, "start": "2021-01-28 03:59:47.960272", "stderr": "", "stderr_lines": [], "stdout": "0caff10a478f2674721da1965013b225f3ea5800", "stdout_lines": ["0caff10a478f2674721da1965013b225f3ea5800"]} 2021-01-28T03:59:47.676 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.044) 0:00:07.740 ****** 2021-01-28T03:59:47.683 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2021-01-28T03:59:47.685 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-28T03:59:47.727 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.051) 0:00:07.792 ****** 2021-01-28T03:59:47.739 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2021-01-28T03:59:47.775 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.048) 0:00:07.840 ****** 2021-01-28T03:59:47.782 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2021-01-28T03:59:47.784 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:47.821 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.045) 0:00:07.885 ****** 2021-01-28T03:59:47.828 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:47.869 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.048) 0:00:07.934 ****** 2021-01-28T03:59:47.877 INFO:teuthology.task.ansible.out: 2021-01-28T03:59:47.878 INFO:teuthology.task.ansible.out:TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:47.914 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.044) 0:00:07.978 ****** 2021-01-28T03:59:47.923 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:47.964 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:47 +0000 (0:00:00.050) 0:00:08.028 ****** 2021-01-28T03:59:47.970 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2021-01-28T03:59:47.972 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.009 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:48 +0000 (0:00:00.045) 0:00:08.073 ****** 2021-01-28T03:59:48.016 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.053 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:48 +0000 (0:00:00.043) 0:00:08.117 ****** 2021-01-28T03:59:48.059 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2021-01-28T03:59:48.061 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.096 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:48 +0000 (0:00:00.043) 0:00:08.160 ****** 2021-01-28T03:59:48.103 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.139 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:48 +0000 (0:00:00.043) 0:00:08.204 ****** 2021-01-28T03:59:48.146 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2021-01-28T03:59:48.149 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.184 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:48 +0000 (0:00:00.044) 0:00:08.248 ****** 2021-01-28T03:59:48.191 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.228 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:48 +0000 (0:00:00.044) 0:00:08.292 ****** 2021-01-28T03:59:48.246 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2021-01-28T03:59:48.247 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.258 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.269 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.271 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.281 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.283 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.293 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.295 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.306 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.307 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.308 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.319 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.321 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEV 2021-01-28T03:59:48.322 INFO:teuthology.task.ansible.out:Gcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.333 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.334 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.344 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.346 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.348 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.358 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.359 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3 2021-01-28T03:59:48.361 INFO:teuthology.task.ansible.out:pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.370 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.372 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4u 2021-01-28T03:59:48.373 INFO:teuthology.task.ansible.out:vZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1C 2021-01-28T03:59:48.375 INFO:teuthology.task.ansible.out:BLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.384 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.384 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.386 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.386 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd 2021-01-28T03:59:48.388 INFO:teuthology.task.ansible.out:5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.398 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.399 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.399 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.399 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.401 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.411 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.413 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.413 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7 2021-01-28T03:59:48.415 INFO:teuthology.task.ansible.out:ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.424 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.425 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.427 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.437 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.439 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.440 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", 2021-01-28T03:59:48.442 INFO:teuthology.task.ansible.out: "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.452 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.454 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.466 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.467 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.468 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@m 2021-01-28T03:59:48.470 INFO:teuthology.task.ansible.out:agrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.479 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.480 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.481 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4 2021-01-28T03:59:48.482 INFO:teuthology.task.ansible.out:e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.491 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.493 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.504 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.505 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.507 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.517 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.519 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.519 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.530 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.531 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.533 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.533 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {" 2021-01-28T03:59:48.535 INFO:teuthology.task.ansible.out:ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.544 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.546 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.557 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.558 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.558 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.559 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.559 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.570 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.572 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.582 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.584 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.584 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.599 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.601 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.611 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.613 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.613 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.624 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.626 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.626 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.637 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.638 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.639 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.649 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.651 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.662 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.663 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.674 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.676 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.676 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.687 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.688 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.699 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.701 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.701 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.703 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.713 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.714 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.714 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.715 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.726 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.727 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost iG3hmp+gS/4aOL4Vp/Nj4w ef1480c222cb2d540cf932ef2f27967891b768c2ad90b59a12a5279ceaa18b47"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.728 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.738 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.740 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.750 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.752 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.763 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.764 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.775 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.777 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.777 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t4 2021-01-28T03:59:48.778 INFO:teuthology.task.ansible.out:80 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.788 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.790 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@localhost QwKbKHfNAOenVV0mkO8NXw 40d74abb20ebba9eaca5e58f6c821670d23f5db5405fc6e3072b985a397c0104"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.800 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.802 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.802 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.803 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rf 2021-01-28T03:59:48.804 INFO:teuthology.task.ansible.out:riedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.813 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.815 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.825 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.827 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.837 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.839 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.839 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.840 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn 2021-01-28T03:59:48.842 INFO:teuthology.task.ansible.out:": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.850 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.852 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.863 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.864 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.865 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.867 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.876 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.878 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.880 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.891 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.892 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.893 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z 2021-01-28T03:59:48.894 INFO:teuthology.task.ansible.out:+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.904 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.905 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.907 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.918 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.919 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.930 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.932 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.933 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.943 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.945 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.956 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.958 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.969 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.969 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.971 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.971 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.982 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.984 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.995 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:48.997 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.013 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.015 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.052 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.824) 0:00:09.116 ****** 2021-01-28T03:59:49.059 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.061 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'dpivonka', 'ovpn': 'dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dpivonka", "ovpn": "dpivonka@thinkpad huZBxlH4VpGff0Q68m/2Rg 43cc9c90a55fa3395862e679b60c5e6c016a59f186e7e8798579cd6046cc4ec8"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'adking', 'ovpn': 'adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adking", "ovpn": "adking@laptop1 VkjYUD1hJpR8sFhrH6MIcg 28c610bc9f7321de315923288d24650bdb4bc90593b423f1f59db16d67b6d625"}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'name': 'amathuri', 'ovpn': 'amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "amathuri", "ovpn": "amathuri@thinkpad WDHZL4VspBmlz5dzRlAGUQ 7f2c5d8e2554b869a09fdc20d6e4aabffa8200ef8e2b8d1bc951bfc673757267"}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.078 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-28T03:59:49.113 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.061) 0:00:09.177 ****** 2021-01-28T03:59:49.152 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.038) 0:00:09.216 ****** 2021-01-28T03:59:49.158 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-28T03:59:49.160 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.203 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.051) 0:00:09.267 ****** 2021-01-28T03:59:49.210 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2021-01-28T03:59:49.252 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.048) 0:00:09.316 ****** 2021-01-28T03:59:49.259 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-28T03:59:49.261 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.304 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.051) 0:00:09.368 ****** 2021-01-28T03:59:49.310 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2021-01-28T03:59:49.312 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.352 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.048) 0:00:09.416 ****** 2021-01-28T03:59:49.358 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-28T03:59:49.360 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.414 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.062) 0:00:09.479 ****** 2021-01-28T03:59:49.421 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2021-01-28T03:59:49.423 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.458 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.043) 0:00:09.522 ****** 2021-01-28T03:59:49.464 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-28T03:59:49.466 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.501 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.042) 0:00:09.565 ****** 2021-01-28T03:59:49.509 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2021-01-28T03:59:49.510 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.546 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.045) 0:00:09.610 ****** 2021-01-28T03:59:49.553 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-01-28T03:59:49.554 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.592 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.045) 0:00:09.656 ****** 2021-01-28T03:59:49.598 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2021-01-28T03:59:49.600 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.654 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.061) 0:00:09.718 ****** 2021-01-28T03:59:49.664 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2021-01-28T03:59:49.666 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.668 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.669 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.670 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.681 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2021-01-28T03:59:49.683 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi134.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.722 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.068) 0:00:09.786 ****** 2021-01-28T03:59:49.729 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.730 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.730 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.731 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.731 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.743 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.745 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.745 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.745 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.756 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.758 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.769 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.771 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.781 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.783 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.783 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.784 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.784 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.795 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.797 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.807 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.809 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.821 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.823 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.823 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.824 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.824 INFO:teuthology.task.ansible.out: 2021-01-28T03:59:49.825 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.826 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.827 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.838 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.840 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.841 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.842 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.844 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.845 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.856 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.857 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.859 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.859 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.860 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.871 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.873 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.873 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.874 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.875 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.877 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.891 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.893 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.936 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:49 +0000 (0:00:00.213) 0:00:10.000 ****** 2021-01-28T03:59:49.944 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.946 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.947 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.948 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.949 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.950 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.963 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.965 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.978 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.980 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.989 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:49.991 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:50.002 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:50.004 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:50.015 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:50.017 INFO:teuthology.task.ansible.out: 2021-01-28T03:59:50.067 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.130) 0:00:10.131 ****** 2021-01-28T03:59:50.573 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2021-01-28T03:59:50.575 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "e880c991f1562524752e643d227b8575ac6e2ed1", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "size": 40, "state": "file", "uid": 0} 2021-01-28T03:59:50.615 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.548) 0:00:10.680 ****** 2021-01-28T03:59:50.657 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.041) 0:00:10.722 ****** 2021-01-28T03:59:50.663 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2021-01-28T03:59:50.666 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => { "msg": "Host smithi134.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-28T03:59:50.721 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.063) 0:00:10.785 ****** 2021-01-28T03:59:50.732 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => { "msg": "Host smithi150.front.sepia.ceph.com is running Ubuntu 20.04 (focal)" } 2021-01-28T03:59:50.796 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.074) 0:00:10.860 ****** 2021-01-28T03:59:50.806 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2021-01-28T03:59:50.807 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-28T03:59:50.848 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.052) 0:00:10.913 ****** 2021-01-28T03:59:50.856 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2021-01-28T03:59:50.895 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.046) 0:00:10.959 ****** 2021-01-28T03:59:50.901 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2021-01-28T03:59:50.904 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:50.939 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.044) 0:00:11.004 ****** 2021-01-28T03:59:50.946 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:50.992 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:50 +0000 (0:00:00.052) 0:00:11.056 ****** 2021-01-28T03:59:51.000 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2021-01-28T03:59:51.002 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.038 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.045) 0:00:11.102 ****** 2021-01-28T03:59:51.045 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.090 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.051) 0:00:11.154 ****** 2021-01-28T03:59:51.096 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2021-01-28T03:59:51.098 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.139 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.048) 0:00:11.203 ****** 2021-01-28T03:59:51.147 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.188 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.049) 0:00:11.252 ****** 2021-01-28T03:59:51.196 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2021-01-28T03:59:51.197 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.247 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.058) 0:00:11.311 ****** 2021-01-28T03:59:51.254 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.304 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.057) 0:00:11.369 ****** 2021-01-28T03:59:51.310 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2021-01-28T03:59:51.312 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.347 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.042) 0:00:11.411 ****** 2021-01-28T03:59:51.354 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.397 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.049) 0:00:11.461 ****** 2021-01-28T03:59:51.404 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2021-01-28T03:59:51.405 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.441 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.044) 0:00:11.506 ****** 2021-01-28T03:59:51.448 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.484 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.042) 0:00:11.548 ****** 2021-01-28T03:59:51.490 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2021-01-28T03:59:51.491 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.526 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.041) 0:00:11.590 ****** 2021-01-28T03:59:51.534 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.570 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.044) 0:00:11.634 ****** 2021-01-28T03:59:51.576 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2021-01-28T03:59:51.577 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.614 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.044) 0:00:11.678 ****** 2021-01-28T03:59:51.620 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.658 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.044) 0:00:11.722 ****** 2021-01-28T03:59:51.665 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2021-01-28T03:59:51.667 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:51.712 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.053) 0:00:11.776 ****** 2021-01-28T03:59:51.718 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:51.720 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:51.783 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.071) 0:00:11.847 ****** 2021-01-28T03:59:51.792 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2021-01-28T03:59:51.794 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.835 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.051) 0:00:11.899 ****** 2021-01-28T03:59:51.842 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.882 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.047) 0:00:11.946 ****** 2021-01-28T03:59:51.890 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2021-01-28T03:59:51.892 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.931 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.049) 0:00:11.995 ****** 2021-01-28T03:59:51.941 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:51.990 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:51 +0000 (0:00:00.058) 0:00:12.054 ****** 2021-01-28T03:59:51.997 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2021-01-28T03:59:52.000 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:52.048 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.057) 0:00:12.112 ****** 2021-01-28T03:59:52.056 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:52.093 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.045) 0:00:12.157 ****** 2021-01-28T03:59:52.099 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2021-01-28T03:59:52.101 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.137 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.043) 0:00:12.201 ****** 2021-01-28T03:59:52.144 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.184 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.046) 0:00:12.248 ****** 2021-01-28T03:59:52.190 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2021-01-28T03:59:52.192 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:52.231 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.047) 0:00:12.295 ****** 2021-01-28T03:59:52.240 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:52.288 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.056) 0:00:12.352 ****** 2021-01-28T03:59:52.294 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2021-01-28T03:59:52.296 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.331 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.043) 0:00:12.396 ****** 2021-01-28T03:59:52.339 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.395 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.063) 0:00:12.459 ****** 2021-01-28T03:59:52.405 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2021-01-28T03:59:52.407 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.442 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.046) 0:00:12.506 ****** 2021-01-28T03:59:52.448 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.487 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.045) 0:00:12.551 ****** 2021-01-28T03:59:52.494 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2021-01-28T03:59:52.496 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.531 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.043) 0:00:12.595 ****** 2021-01-28T03:59:52.538 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.579 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.048) 0:00:12.643 ****** 2021-01-28T03:59:52.587 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2021-01-28T03:59:52.588 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.624 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.045) 0:00:12.688 ****** 2021-01-28T03:59:52.631 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.669 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.044) 0:00:12.733 ****** 2021-01-28T03:59:52.677 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2021-01-28T03:59:52.679 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:52.728 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.059) 0:00:12.792 ****** 2021-01-28T03:59:52.739 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:52.778 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.049) 0:00:12.842 ****** 2021-01-28T03:59:52.784 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-28T03:59:52.786 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.822 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.044) 0:00:12.886 ****** 2021-01-28T03:59:52.828 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.865 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.043) 0:00:12.929 ****** 2021-01-28T03:59:52.873 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2021-01-28T03:59:52.875 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.914 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.049) 0:00:12.979 ****** 2021-01-28T03:59:52.921 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:52.960 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:52 +0000 (0:00:00.045) 0:00:13.024 ****** 2021-01-28T03:59:52.965 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2021-01-28T03:59:52.967 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.002 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.042) 0:00:13.067 ****** 2021-01-28T03:59:53.009 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.049 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.047) 0:00:13.114 ****** 2021-01-28T03:59:53.055 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2021-01-28T03:59:53.057 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.094 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.044) 0:00:13.158 ****** 2021-01-28T03:59:53.100 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.143 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.048) 0:00:13.207 ****** 2021-01-28T03:59:53.150 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2021-01-28T03:59:53.152 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.187 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.044) 0:00:13.251 ****** 2021-01-28T03:59:53.196 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.232 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.044) 0:00:13.296 ****** 2021-01-28T03:59:53.238 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2021-01-28T03:59:53.240 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.275 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.042) 0:00:13.339 ****** 2021-01-28T03:59:53.282 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.319 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.043) 0:00:13.383 ****** 2021-01-28T03:59:53.324 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2021-01-28T03:59:53.326 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:53.361 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.042) 0:00:13.425 ****** 2021-01-28T03:59:53.367 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T03:59:53.404 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.043) 0:00:13.468 ****** 2021-01-28T03:59:53.410 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2021-01-28T03:59:53.412 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.452 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.047) 0:00:13.516 ****** 2021-01-28T03:59:53.460 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.499 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.046) 0:00:13.563 ****** 2021-01-28T03:59:53.506 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2021-01-28T03:59:53.508 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.544 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.045) 0:00:13.608 ****** 2021-01-28T03:59:53.552 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.590 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.045) 0:00:13.654 ****** 2021-01-28T03:59:53.596 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2021-01-28T03:59:53.597 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.633 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.043) 0:00:13.697 ****** 2021-01-28T03:59:53.639 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.677 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.043) 0:00:13.741 ****** 2021-01-28T03:59:53.683 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2021-01-28T03:59:53.685 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.722 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.045) 0:00:13.786 ****** 2021-01-28T03:59:53.728 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.730 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.770 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.047) 0:00:13.834 ****** 2021-01-28T03:59:53.776 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2021-01-28T03:59:53.777 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.815 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.045) 0:00:13.879 ****** 2021-01-28T03:59:53.822 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.824 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "item": "epel-testing-mirrorlist", "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.860 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.045) 0:00:13.925 ****** 2021-01-28T03:59:53.871 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2021-01-28T03:59:53.872 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.929 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.069) 0:00:13.994 ****** 2021-01-28T03:59:53.937 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:53.982 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:53 +0000 (0:00:00.052) 0:00:14.046 ****** 2021-01-28T03:59:54.084 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-28T03:59:54.086 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.016655", "end": "2021-01-28 03:59:53.740404", "rc": 0, "start": "2021-01-28 03:59:53.723749", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-28T03:59:54.121 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.138) 0:00:14.185 ****** 2021-01-28T03:59:54.138 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": "cat /etc/timezone", "delta": "0:00:00.010046", "end": "2021-01-28 03:59:54.489515", "rc": 0, "start": "2021-01-28 03:59:54.479469", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2021-01-28T03:59:54.173 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.052) 0:00:14.237 ****** 2021-01-28T03:59:54.179 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2021-01-28T03:59:54.181 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.216 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.042) 0:00:14.280 ****** 2021-01-28T03:59:54.222 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.260 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.044) 0:00:14.324 ****** 2021-01-28T03:59:54.266 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2021-01-28T03:59:54.268 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.306 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.045) 0:00:14.370 ****** 2021-01-28T03:59:54.313 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.371 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.065) 0:00:14.435 ****** 2021-01-28T03:59:54.377 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2021-01-28T03:59:54.379 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.414 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.042) 0:00:14.478 ****** 2021-01-28T03:59:54.420 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.456 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.042) 0:00:14.520 ****** 2021-01-28T03:59:54.462 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2021-01-28T03:59:54.464 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.500 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.043) 0:00:14.564 ****** 2021-01-28T03:59:54.515 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.554 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.054) 0:00:14.618 ****** 2021-01-28T03:59:54.560 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2021-01-28T03:59:54.562 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.604 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.049) 0:00:14.668 ****** 2021-01-28T03:59:54.615 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.656 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.052) 0:00:14.720 ****** 2021-01-28T03:59:54.663 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2021-01-28T03:59:54.665 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.703 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.046) 0:00:14.767 ****** 2021-01-28T03:59:54.710 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.749 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.046) 0:00:14.813 ****** 2021-01-28T03:59:54.759 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2021-01-28T03:59:54.760 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.807 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.057) 0:00:14.871 ****** 2021-01-28T03:59:54.815 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:54.854 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:54 +0000 (0:00:00.046) 0:00:14.918 ****** 2021-01-28T03:59:55.145 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-28T03:59:55.148 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.154042", "end": "2021-01-28 03:59:55.500447", "rc": 0, "start": "2021-01-28 03:59:55.346405", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:59:55.194 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:55 +0000 (0:00:00.339) 0:00:15.258 ****** 2021-01-28T03:59:55.221 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-01-28T03:59:55.223 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:55.263 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:55 +0000 (0:00:00.069) 0:00:15.327 ****** 2021-01-28T03:59:55.492 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-28T03:59:55.494 INFO:teuthology.task.ansible.out:[WARNING]: Consider using the apt module rather than running 'apt-get'. If you need to use command because apt is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.089997", "end": "2021-01-28 03:59:55.837610", "rc": 0, "start": "2021-01-28 03:59:55.747613", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:59:55.529 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:55 +0000 (0:00:00.265) 0:00:15.593 ****** 2021-01-28T03:59:55.840 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2021-01-28T03:59:55.843 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.907332", "end": "2021-01-28 03:59:55.500403", "rc": 0, "start": "2021-01-28 03:59:54.593071", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:59:55.880 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:55 +0000 (0:00:00.350) 0:00:15.944 ****** 2021-01-28T03:59:55.907 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2021-01-28T03:59:55.909 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T03:59:55.954 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:55 +0000 (0:00:00.074) 0:00:16.018 ****** 2021-01-28T03:59:56.202 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2021-01-28T03:59:56.204 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["apt-get", "clean"], "delta": "0:00:00.088515", "end": "2021-01-28 03:59:55.858087", "rc": 0, "start": "2021-01-28 03:59:55.769572", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T03:59:56.238 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:56 +0000 (0:00:00.284) 0:00:16.303 ****** 2021-01-28T03:59:59.187 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** ok: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T03:59:59.230 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:59 +0000 (0:00:02.991) 0:00:19.294 ****** 2021-01-28T03:59:59.359 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"attempts": 1, "cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T03:59:59.396 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:59 +0000 (0:00:00.166) 0:00:19.460 ****** 2021-01-28T03:59:59.925 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-28T03:59:59.927 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T03:59:59.962 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 03:59:59 +0000 (0:00:00.565) 0:00:20.026 ****** 2021-01-28T03:59:59.989 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-28T03:59:59.990 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:00.041 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:00 +0000 (0:00:00.079) 0:00:20.105 ****** 2021-01-28T04:00:00.071 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2021-01-28T04:00:00.073 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:00:00.113 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:00 +0000 (0:00:00.071) 0:00:20.177 ****** 2021-01-28T04:00:00.140 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2021-01-28T04:00:00.142 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:00.176 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:00 +0000 (0:00:00.062) 0:00:20.240 ****** 2021-01-28T04:00:00.361 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2021-01-28T04:00:00.363 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-28T04:00:00.402 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:00 +0000 (0:00:00.225) 0:00:20.466 ****** 2021-01-28T04:00:00.492 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "size": 131, "state": "file", "uid": 0} 2021-01-28T04:00:00.529 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:00 +0000 (0:00:00.126) 0:00:20.593 ****** 2021-01-28T04:00:01.063 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2021-01-28T04:00:01.065 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:00:01.127 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:01 +0000 (0:00:00.598) 0:00:21.191 ****** 2021-01-28T04:00:01.168 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:00:01.205 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:01 +0000 (0:00:00.078) 0:00:21.269 ****** 2021-01-28T04:00:01.501 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2021-01-28T04:00:01.503 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-28T04:00:01.555 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "size": 2716736, "state": "file", "uid": 0} 2021-01-28T04:00:01.818 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-28T04:00:01.863 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "size": 1952038, "state": "file", "uid": 0} 2021-01-28T04:00:02.107 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-28T04:00:02.153 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:02 +0000 (0:00:00.947) 0:00:22.217 ****** 2021-01-28T04:00:02.161 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "size": 580432, "state": "file", "uid": 0} 2021-01-28T04:00:02.209 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:02 +0000 (0:00:00.056) 0:00:22.273 ****** 2021-01-28T04:00:02.283 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2021-01-28T04:00:02.285 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:00:02.343 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:02 +0000 (0:00:00.133) 0:00:22.407 ****** 2021-01-28T04:00:02.364 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:00:02.414 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:02 +0000 (0:00:00.070) 0:00:22.478 ****** 2021-01-28T04:00:02.664 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-28T04:00:02.666 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-28T04:00:02.746 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "00d0404b545463be4a65f475e0870e07a48f35b6", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "size": 13355, "state": "file", "uid": 0} 2021-01-28T04:00:02.982 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-28T04:00:03.080 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "size": 8602, "state": "file", "uid": 0} 2021-01-28T04:00:03.323 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-28T04:00:03.367 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.953) 0:00:23.432 ****** 2021-01-28T04:00:03.417 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-28T04:00:03.420 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-28T04:00:03.482 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.114) 0:00:23.546 ****** 2021-01-28T04:00:03.491 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2021-01-28T04:00:03.494 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "size": 3605, "state": "file", "uid": 0} 2021-01-28T04:00:03.535 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.052) 0:00:23.599 ****** 2021-01-28T04:00:03.542 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-28T04:00:03.544 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.614 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.079) 0:00:23.678 ****** 2021-01-28T04:00:03.626 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2021-01-28T04:00:03.628 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib/nagios/plugins", "nrpe_group": "nagios", "nrpe_packages": ["nagios-nrpe-server", "nagios-plugins-basic"], "nrpe_service_name": "nagios-nrpe-server", "nrpe_user": "nagios"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/apt_systems.yml"], "changed": false} 2021-01-28T04:00:03.667 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.052) 0:00:23.731 ****** 2021-01-28T04:00:03.677 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-28T04:00:03.679 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T04:00:03.718 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.050) 0:00:23.782 ****** 2021-01-28T04:00:03.725 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2021-01-28T04:00:03.727 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.767 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.049) 0:00:23.832 ****** 2021-01-28T04:00:03.791 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-28T04:00:03.794 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.799 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.812 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.815 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2021-01-28T04:00:03.817 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T04:00:03.817 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2021-01-28T04:00:03.817 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.860 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.092) 0:00:23.924 ****** 2021-01-28T04:00:03.920 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.059) 0:00:23.984 ****** 2021-01-28T04:00:03.929 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.930 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.931 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.932 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:03.969 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:03 +0000 (0:00:00.049) 0:00:24.033 ****** 2021-01-28T04:00:03.976 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2021-01-28T04:00:03.978 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:04.016 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:04 +0000 (0:00:00.047) 0:00:24.081 ****** 2021-01-28T04:00:04.023 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:04.061 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:04 +0000 (0:00:00.044) 0:00:24.125 ****** 2021-01-28T04:00:04.690 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2021-01-28T04:00:04.692 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:00:04.737 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:04 +0000 (0:00:00.675) 0:00:24.801 ****** 2021-01-28T04:00:04.779 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:00:04.821 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:04 +0000 (0:00:00.084) 0:00:24.886 ****** 2021-01-28T04:00:05.080 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2021-01-28T04:00:05.082 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-28T04:00:05.119 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.297) 0:00:25.183 ****** 2021-01-28T04:00:05.157 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "4880e187ff9f437cc33858eb1d0fa49a06d67be4", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "size": 180, "state": "file", "uid": 0} 2021-01-28T04:00:05.194 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.074) 0:00:25.258 ****** 2021-01-28T04:00:05.440 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2021-01-28T04:00:05.442 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-28T04:00:05.479 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.285) 0:00:25.543 ****** 2021-01-28T04:00:05.528 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/nagios/plugins/check_mem.sh", "size": 1964, "state": "file", "uid": 0} 2021-01-28T04:00:05.574 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.094) 0:00:25.638 ****** 2021-01-28T04:00:05.625 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-28T04:00:05.628 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-28T04:00:05.721 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "DAEMON_OPTS", "msg": ""} 2021-01-28T04:00:05.733 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-28T04:00:05.771 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.197) 0:00:25.835 ****** 2021-01-28T04:00:05.799 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-28T04:00:05.801 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:05.841 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.069) 0:00:25.905 ****** 2021-01-28T04:00:05.848 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2021-01-28T04:00:05.850 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "backup": "", "changed": false, "item": "NRPE_OPTS", "msg": ""} 2021-01-28T04:00:05.890 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.049) 0:00:25.954 ****** 2021-01-28T04:00:05.898 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-28T04:00:05.899 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T04:00:05.935 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.044) 0:00:25.999 ****** 2021-01-28T04:00:05.937 INFO:teuthology.task.ansible.out: 2021-01-28T04:00:05.942 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2021-01-28T04:00:05.944 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:05.980 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:05 +0000 (0:00:00.045) 0:00:26.044 ****** 2021-01-28T04:00:05.988 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-28T04:00:05.990 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:06.025 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:06 +0000 (0:00:00.044) 0:00:26.089 ****** 2021-01-28T04:00:06.031 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2021-01-28T04:00:06.032 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2021-01-28T04:00:06.074 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:06 +0000 (0:00:00.049) 0:00:26.138 ****** 2021-01-28T04:00:06.117 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2021-01-28T04:00:06.119 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:06.157 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:06 +0000 (0:00:00.083) 0:00:26.222 ****** 2021-01-28T04:00:06.385 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2021-01-28T04:00:06.387 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-28T04:00:06.428 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:06 +0000 (0:00:00.270) 0:00:26.492 ****** 2021-01-28T04:00:06.489 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "a0ee4c31e844cf26108115f6af99f92f904eafbf", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "size": 1176, "state": "file", "uid": 0} 2021-01-28T04:00:06.529 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:06 +0000 (0:00:00.100) 0:00:26.593 ****** 2021-01-28T04:00:07.155 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2021-01-28T04:00:07.156 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:59:10 UTC", "ActiveEnterTimestampMonotonic": "16161221", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target nss-lookup.target systemd-journald.socket var-run.mount local-fs.target time-sync.target -.mount basic.target systemd-tmpfiles-setup.service system.slice network.target remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:59:10 UTC", "AssertTimestampMonotonic": "16119343", "Before": "getty@tty1.service multi-user.target xdm.service shutdown.target plymouth-quit.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:59:10 UTC", "Co 2021-01-28T04:00:07.157 INFO:teuthology.task.ansible.out:nditionTimestampMonotonic": "16119342", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "942", "ExecMainStartTimestamp": "Thu 2021-01-28 03:59:10 UTC", "ExecMainStartTimestampMonotonic": "16161090", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-01-28 03:59:10 UTC] ; stop_time=[n/a] ; pid=942 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Thu 2021-01-28 03:59:10 UTC] ; stop_time=[n/a] ; pid=942 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GI 2021-01-28T04:00:07.159 INFO:teuthology.task.ansible.out:D": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:59:10 UTC", "InactiveExitTimestampMonotonic": "16161221", "InvocationID": "a5829476908c4e37834b5ce7af28b158", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "942", "MemoryAccounting": "yes", "MemoryCurrent": "856064", "MemoryDe 2021-01-28T04:00:07.161 INFO:teuthology.task.ansible.out:nyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:59:10 UTC", "StateChangeTimestampMonotonic": "16161221", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", 2021-01-28T04:00:07.162 INFO:teuthology.task.ansible.out: "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nagios-nrpe-server", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:59:14 UTC", "ActiveEnterTimestampMonotonic": "16283787", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "system.slice local-fs.target systemd-tmpfiles-setup.service sysinit.target network.target systemd-journald.socket time-sync.target basic.target -.mount nss-lookup.target remote-fs.target var-run.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:59:14 UTC", "AssertTimestampMonotonic": "16259172", "Before": "plymouth-quit.service getty@tty1.service shutdown.target multi-user.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": " 2021-01-28T04:00:07.164 INFO:teuthology.task.ansible.out:yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:59:14 UTC", "ConditionTimestampMonotonic": "16259171", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nagios-nrpe-server.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/default/nagios-nrpe-server (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "912", "ExecMainStartTimestamp": "Thu 2021-01-28 03:59:14 UTC", "ExecMainStartTimestampMonotonic": "16283623", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; ignore_errors=no ; start_time=[Thu 2021-01-28 03:59:14 UTC] ; stop_time=[n/a] 2021-01-28T04:00:07.165 INFO:teuthology.task.ansible.out:; pid=912 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_OPTS ; flags= ; start_time=[Thu 2021-01-28 03:59:14 UTC] ; stop_time=[n/a] ; pid=912 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopPostEx": "{ path=/bin/rm ; argv[]=/bin/rm -f /run/nagios/nrpe.pid ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/nagios-nrpe-server.service", "GID": "118", "Group": "nagios", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "nagios-nrpe-server.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:59:14 UTC", "InactiveExitTimestampMonotonic": "16283787", "InvocationID": "88a2cd897f87499989fb33f0e025acbd", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLO 2021-01-28T04:00:07.167 INFO:teuthology.task.ansible.out:CKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "912", "MemoryAccounting": "yes", "MemoryCurrent": "851968", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nagios-nrpe-server.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/run/nagios/nrpe.pid", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirector 2021-01-28T04:00:07.168 INFO:teuthology.task.ansible.out:yStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:59:14 UTC", "StateChangeTimestampMonotonic": "16283787", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "38334", "TimeoutAbortUSec": "1min", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "110", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "User": "nagios", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T04:00:07.195 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.666) 0:00:27.259 ****** 2021-01-28T04:00:07.228 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.032) 0:00:27.292 ****** 2021-01-28T04:00:07.233 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2021-01-28T04:00:07.235 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.270 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.041) 0:00:27.334 ****** 2021-01-28T04:00:07.278 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.313 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.043) 0:00:27.378 ****** 2021-01-28T04:00:07.319 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2021-01-28T04:00:07.321 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.357 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.043) 0:00:27.421 ****** 2021-01-28T04:00:07.364 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.401 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.043) 0:00:27.465 ****** 2021-01-28T04:00:07.406 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2021-01-28T04:00:07.408 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.446 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.044) 0:00:27.510 ****** 2021-01-28T04:00:07.453 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.510 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.064) 0:00:27.574 ****** 2021-01-28T04:00:07.521 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2021-01-28T04:00:07.523 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.563 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.052) 0:00:27.627 ****** 2021-01-28T04:00:07.571 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.611 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.048) 0:00:27.675 ****** 2021-01-28T04:00:07.618 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2021-01-28T04:00:07.619 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.656 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.044) 0:00:27.720 ****** 2021-01-28T04:00:07.662 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.703 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.046) 0:00:27.767 ****** 2021-01-28T04:00:07.709 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2021-01-28T04:00:07.711 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.749 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.046) 0:00:27.813 ****** 2021-01-28T04:00:07.757 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.798 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.048) 0:00:27.862 ****** 2021-01-28T04:00:07.804 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2021-01-28T04:00:07.806 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.844 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.045) 0:00:27.908 ****** 2021-01-28T04:00:07.852 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.891 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.047) 0:00:27.955 ****** 2021-01-28T04:00:07.898 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2021-01-28T04:00:07.900 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.939 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.047) 0:00:28.003 ****** 2021-01-28T04:00:07.946 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:07.985 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:07 +0000 (0:00:00.046) 0:00:28.049 ****** 2021-01-28T04:00:07.992 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2021-01-28T04:00:07.993 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:08.032 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.046) 0:00:28.096 ****** 2021-01-28T04:00:08.040 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:08.080 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.047) 0:00:28.144 ****** 2021-01-28T04:00:08.087 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2021-01-28T04:00:08.090 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:08.137 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.056) 0:00:28.201 ****** 2021-01-28T04:00:08.144 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:08.182 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.045) 0:00:28.246 ****** 2021-01-28T04:00:08.189 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2021-01-28T04:00:08.190 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-28T04:00:08.227 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.044) 0:00:28.291 ****** 2021-01-28T04:00:08.234 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"apt_repos": [], "ceph_packages_to_remove": ["ceph", "ceph-common", "libcephfs1", "radosgw", "python-ceph", "python-rados", "python-cephfs", "python-rbd", "librbd1", "librados2", "ceph-fs-common-dbg", "ceph-fs-common"], "common_apt_repos": [], "common_packages": [], "nfs_service": "nfs-kernel-server", "ntp_service_name": "ntp", "packages": [], "packages_to_remove": ["multipath-tools"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "ssh"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/apt_systems.yml"], "changed": false} 2021-01-28T04:00:08.273 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.045) 0:00:28.337 ****** 2021-01-28T04:00:08.279 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2021-01-28T04:00:08.281 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-28T04:00:08.321 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.048) 0:00:28.385 ****** 2021-01-28T04:00:08.328 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml) => {"ansible_facts": {"common_packages": ["libfcgi0ldbl", "python-dev", "libev-dev", "perl", "libwww-perl", "lsb-release", "build-essential", "sysstat", "gdb", "libedit2", "cryptsetup-bin", "xfsprogs", "gdisk", "parted", "libuuid1", "libatomic-ops-dev", "git-core", "attr", "dbench", "bonnie++", "valgrind", "ant", "libtool", "automake", "gettext", "uuid-dev", "libacl1-dev", "bc", "xfsdump", "xfslibs-dev", "libattr1-dev", "quota", "libcap2-bin", "libncurses5-dev", "lvm2", "vim", "pdsh", "collectl", "blktrace", "genisoimage", "libjson-xs-perl", "xml-twig-tools", "default-jdk", "junit4", "tgt", "open-iscsi", "cifs-utils", "ipcalc", "nfs-common", "nfs-kernel-server", "software-properties-common"], "non_aarch64_common_packages": ["smbios-utils", "libfcgi", "sysprof"], "non_aarch64_packages_to_upgrade": ["libapache2-mod-fastcgi"], "packages_to_remove": ["openmpi-common"], "packages_to_upgrade": ["apt", "apache2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu.yml"} 2021-01-28T04:00:08.374 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.053) 0:00:28.438 ****** 2021-01-28T04:00:08.380 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2021-01-28T04:00:08.382 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-28T04:00:08.430 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.056) 0:00:28.494 ****** 2021-01-28T04:00:08.438 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml) => {"ansible_facts": {"non_aarch64_packages": ["libgoogle-perftools4", "iozone3"], "non_aarch64_packages_to_upgrade": [], "packages": ["mpich", "qemu-system-x86", "lttng-tools", "libtool-bin", "docker.io", "python3-nose", "python3-virtualenv", "python3-configobj", "python3-gevent", "python3-numpy", "python3-matplotlib", "python3-setuptools"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/ubuntu_20.yml"} 2021-01-28T04:00:08.478 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.048) 0:00:28.543 ****** 2021-01-28T04:00:08.484 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2021-01-28T04:00:08.486 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-28T04:00:08.523 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.044) 0:00:28.587 ****** 2021-01-28T04:00:08.529 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2021-01-28T04:00:08.568 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.044) 0:00:28.632 ****** 2021-01-28T04:00:08.651 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2021-01-28T04:00:08.654 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-28T04:00:08.690 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.122) 0:00:28.755 ****** 2021-01-28T04:00:08.709 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 27, "name": "sudo", "state": "present", "system": false} 2021-01-28T04:00:08.751 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.060) 0:00:28.815 ****** 2021-01-28T04:00:08.822 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2021-01-28T04:00:08.824 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-28T04:00:08.874 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:08 +0000 (0:00:00.122) 0:00:28.938 ****** 2021-01-28T04:00:08.894 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "name": "ubuntu", "state": "present", "system": false} 2021-01-28T04:00:09.035 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.161) 0:00:29.099 ****** 2021-01-28T04:00:09.045 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2021-01-28T04:00:09.048 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:09.085 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.050) 0:00:29.150 ****** 2021-01-28T04:00:09.093 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:09.130 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.044) 0:00:29.194 ****** 2021-01-28T04:00:09.136 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2021-01-28T04:00:09.137 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:09.172 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.042) 0:00:29.236 ****** 2021-01-28T04:00:09.180 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:09.219 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.046) 0:00:29.283 ****** 2021-01-28T04:00:09.320 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2021-01-28T04:00:09.322 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-28T04:00:09.357 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.138) 0:00:29.422 ****** 2021-01-28T04:00:09.375 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/sh", "state": "present", "uid": 10101} 2021-01-28T04:00:09.413 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.055) 0:00:29.477 ****** 2021-01-28T04:00:09.755 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2021-01-28T04:00:09.757 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-28T04:00:09.793 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.380) 0:00:29.857 ****** 2021-01-28T04:00:09.810 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "size": 112, "state": "file", "uid": 0} 2021-01-28T04:00:09.850 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.056) 0:00:29.914 ****** 2021-01-28T04:00:09.857 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2021-01-28T04:00:09.859 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi134"}, "changed": false} 2021-01-28T04:00:09.896 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.046) 0:00:29.960 ****** 2021-01-28T04:00:09.902 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi150"}, "changed": false} 2021-01-28T04:00:09.941 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:09 +0000 (0:00:00.044) 0:00:30.005 ****** 2021-01-28T04:00:10.625 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2021-01-28T04:00:10.627 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi134.front.sepia.ceph.com", "ansible_hostname": "smithi134", "ansible_nodename": "smithi134"}, "changed": true, "name": "smithi134"} changed: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi150.front.sepia.ceph.com", "ansible_hostname": "smithi150", "ansible_nodename": "smithi150"}, "changed": true, "name": "smithi150"} 2021-01-28T04:00:10.665 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:10 +0000 (0:00:00.723) 0:00:30.729 ****** 2021-01-28T04:00:10.712 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:10 +0000 (0:00:00.046) 0:00:30.776 ****** 2021-01-28T04:00:10.983 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2021-01-28T04:00:10.985 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-28T04:00:11.043 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:11 +0000 (0:00:00.331) 0:00:31.108 ****** 2021-01-28T04:00:11.053 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "2f7bfea2455a0d9220592aa0c21ac69c312e7471", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "size": 2646, "state": "file", "uid": 0} 2021-01-28T04:00:11.094 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:11 +0000 (0:00:00.050) 0:00:31.158 ****** 2021-01-28T04:00:11.365 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2021-01-28T04:00:11.367 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-28T04:00:11.406 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:11 +0000 (0:00:00.312) 0:00:31.470 ****** 2021-01-28T04:00:11.426 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "size": 570, "state": "file", "uid": 0} 2021-01-28T04:00:11.465 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:11 +0000 (0:00:00.058) 0:00:31.529 ****** 2021-01-28T04:00:12.048 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-01-28T04:00:12.050 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-28T04:00:12.087 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.622) 0:00:32.151 ****** 2021-01-28T04:00:12.116 INFO:teuthology.task.ansible.out: 2021-01-28T04:00:12.118 INFO:teuthology.task.ansible.out:TASK [testnode : Create remote.conf] ******************************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.156 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.068) 0:00:32.220 ****** 2021-01-28T04:00:12.163 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2021-01-28T04:00:12.165 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2021-01-28T04:00:12.210 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.053) 0:00:32.274 ****** 2021-01-28T04:00:12.216 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-28T04:00:12.218 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.260 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.050) 0:00:32.324 ****** 2021-01-28T04:00:12.271 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2021-01-28T04:00:12.273 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.323 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.062) 0:00:32.387 ****** 2021-01-28T04:00:12.330 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-28T04:00:12.332 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.366 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.043) 0:00:32.430 ****** 2021-01-28T04:00:12.374 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-28T04:00:12.375 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.410 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.043) 0:00:32.474 ****** 2021-01-28T04:00:12.416 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-28T04:00:12.418 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.455 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.044) 0:00:32.519 ****** 2021-01-28T04:00:12.463 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-28T04:00:12.465 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.503 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.048) 0:00:32.567 ****** 2021-01-28T04:00:12.513 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-28T04:00:12.515 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.559 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.056) 0:00:32.624 ****** 2021-01-28T04:00:12.566 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-28T04:00:12.568 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.604 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.044) 0:00:32.668 ****** 2021-01-28T04:00:12.610 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-28T04:00:12.612 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.647 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.043) 0:00:32.711 ****** 2021-01-28T04:00:12.654 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-28T04:00:12.656 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.692 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.045) 0:00:32.756 ****** 2021-01-28T04:00:12.700 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-28T04:00:12.701 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.738 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.045) 0:00:32.802 ****** 2021-01-28T04:00:12.745 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.784 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.046) 0:00:32.848 ****** 2021-01-28T04:00:12.791 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-28T04:00:12.793 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.829 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.045) 0:00:32.894 ****** 2021-01-28T04:00:12.836 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-28T04:00:12.838 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.887 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.057) 0:00:32.951 ****** 2021-01-28T04:00:12.894 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-28T04:00:12.936 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.049) 0:00:33.001 ****** 2021-01-28T04:00:12.943 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2021-01-28T04:00:12.945 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:12.983 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:12 +0000 (0:00:00.046) 0:00:33.047 ****** 2021-01-28T04:00:12.991 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-28T04:00:13.027 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.044) 0:00:33.091 ****** 2021-01-28T04:00:13.035 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2021-01-28T04:00:13.072 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.044) 0:00:33.136 ****** 2021-01-28T04:00:13.078 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-28T04:00:13.124 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.052) 0:00:33.189 ****** 2021-01-28T04:00:13.133 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2021-01-28T04:00:13.174 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.049) 0:00:33.238 ****** 2021-01-28T04:00:13.181 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-28T04:00:13.182 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.221 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.046) 0:00:33.285 ****** 2021-01-28T04:00:13.230 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2021-01-28T04:00:13.274 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.053) 0:00:33.338 ****** 2021-01-28T04:00:13.280 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-28T04:00:13.282 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.320 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.046) 0:00:33.384 ****** 2021-01-28T04:00:13.328 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2021-01-28T04:00:13.329 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.366 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.045) 0:00:33.430 ****** 2021-01-28T04:00:13.375 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-28T04:00:13.376 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.417 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.050) 0:00:33.481 ****** 2021-01-28T04:00:13.426 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2021-01-28T04:00:13.428 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.465 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.048) 0:00:33.529 ****** 2021-01-28T04:00:13.471 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:00:13.473 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.513 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.047) 0:00:33.577 ****** 2021-01-28T04:00:13.520 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2021-01-28T04:00:13.522 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.557 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.044) 0:00:33.621 ****** 2021-01-28T04:00:13.563 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-28T04:00:13.565 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.604 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.046) 0:00:33.668 ****** 2021-01-28T04:00:13.611 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:00:13.613 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.654 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.050) 0:00:33.718 ****** 2021-01-28T04:00:13.664 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-28T04:00:13.666 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.701 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.047) 0:00:33.766 ****** 2021-01-28T04:00:13.709 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2021-01-28T04:00:13.712 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.756 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.054) 0:00:33.820 ****** 2021-01-28T04:00:13.763 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-28T04:00:13.766 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.801 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.044) 0:00:33.865 ****** 2021-01-28T04:00:13.807 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2021-01-28T04:00:13.810 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.844 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.042) 0:00:33.908 ****** 2021-01-28T04:00:13.851 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-28T04:00:13.853 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.889 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.045) 0:00:33.953 ****** 2021-01-28T04:00:13.896 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2021-01-28T04:00:13.897 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.932 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.042) 0:00:33.996 ****** 2021-01-28T04:00:13.938 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-28T04:00:13.940 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:13.974 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:13 +0000 (0:00:00.042) 0:00:34.039 ****** 2021-01-28T04:00:13.982 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2021-01-28T04:00:13.984 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.018 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.043) 0:00:34.082 ****** 2021-01-28T04:00:14.024 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-28T04:00:14.026 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.066 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.048) 0:00:34.130 ****** 2021-01-28T04:00:14.072 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-28T04:00:14.074 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.114 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.048) 0:00:34.178 ****** 2021-01-28T04:00:14.121 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T04:00:14.123 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.159 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.044) 0:00:34.223 ****** 2021-01-28T04:00:14.166 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-28T04:00:14.168 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.203 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.044) 0:00:34.267 ****** 2021-01-28T04:00:14.209 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-28T04:00:14.211 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.249 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.045) 0:00:34.313 ****** 2021-01-28T04:00:14.255 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T04:00:14.257 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.292 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.043) 0:00:34.357 ****** 2021-01-28T04:00:14.300 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-28T04:00:14.301 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.336 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.043) 0:00:34.400 ****** 2021-01-28T04:00:14.343 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2021-01-28T04:00:14.344 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.382 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.046) 0:00:34.446 ****** 2021-01-28T04:00:14.388 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T04:00:14.389 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.433 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.050) 0:00:34.497 ****** 2021-01-28T04:00:14.439 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-28T04:00:14.441 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.476 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.043) 0:00:34.541 ****** 2021-01-28T04:00:14.484 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-28T04:00:14.485 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.522 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.045) 0:00:34.587 ****** 2021-01-28T04:00:14.528 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T04:00:14.530 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.565 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.042) 0:00:34.629 ****** 2021-01-28T04:00:14.571 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-28T04:00:14.572 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.608 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.042) 0:00:34.672 ****** 2021-01-28T04:00:14.616 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2021-01-28T04:00:14.618 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.652 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.044) 0:00:34.717 ****** 2021-01-28T04:00:14.659 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-01-28T04:00:14.661 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.696 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.043) 0:00:34.760 ****** 2021-01-28T04:00:14.702 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2021-01-28T04:00:14.704 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.740 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.044) 0:00:34.805 ****** 2021-01-28T04:00:14.746 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2021-01-28T04:00:14.748 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.784 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.043) 0:00:34.848 ****** 2021-01-28T04:00:14.791 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2021-01-28T04:00:14.792 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.829 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.045) 0:00:34.893 ****** 2021-01-28T04:00:14.835 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-28T04:00:14.837 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.893 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.064) 0:00:34.957 ****** 2021-01-28T04:00:14.902 INFO:teuthology.task.ansible.out: 2021-01-28T04:00:14.904 INFO:teuthology.task.ansible.out:TASK [testnode : Install abrt] ************************************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.944 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.050) 0:00:35.008 ****** 2021-01-28T04:00:14.951 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-28T04:00:14.953 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:14.987 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:14 +0000 (0:00:00.043) 0:00:35.052 ****** 2021-01-28T04:00:14.996 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2021-01-28T04:00:14.998 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:15.034 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.046) 0:00:35.098 ****** 2021-01-28T04:00:15.040 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-28T04:00:15.042 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:15.078 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.043) 0:00:35.142 ****** 2021-01-28T04:00:15.084 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2021-01-28T04:00:15.086 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:15.128 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.050) 0:00:35.192 ****** 2021-01-28T04:00:15.135 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-28T04:00:15.136 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:15.172 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.043) 0:00:35.236 ****** 2021-01-28T04:00:15.180 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2021-01-28T04:00:15.181 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:15.219 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.046) 0:00:35.283 ****** 2021-01-28T04:00:15.248 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2021-01-28T04:00:15.249 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:15.286 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.066) 0:00:35.350 ****** 2021-01-28T04:00:15.314 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-28T04:00:15.316 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005255", "end": "2021-01-28 04:00:14.976870", "rc": 0, "start": "2021-01-28 04:00:14.971615", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:00:15.354 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.067) 0:00:35.418 ****** 2021-01-28T04:00:15.383 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-28T04:00:15.420 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.066) 0:00:35.484 ****** 2021-01-28T04:00:15.437 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2021-01-28T04:00:15.439 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": "ls -1 /etc/apt/sources.list.d/", "delta": "0:00:00.005376", "end": "2021-01-28 04:00:15.781650", "rc": 0, "start": "2021-01-28 04:00:15.776274", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:00:15.475 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.054) 0:00:35.539 ****** 2021-01-28T04:00:15.501 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2021-01-28T04:00:15.538 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.063) 0:00:35.602 ****** 2021-01-28T04:00:15.732 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-28T04:00:15.734 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-28T04:00:15.769 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.230) 0:00:35.833 ****** 2021-01-28T04:00:15.805 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-01-28T04:00:15.807 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:15.842 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.073) 0:00:35.906 ****** 2021-01-28T04:00:15.860 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2021-01-28T04:00:15.862 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "ba101482124806c7f6ea9fc7b4acfda303391ad6", "dest": "/etc/apt/preferences.d/ceph.pref", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/apt/preferences.d/ceph.pref", "size": 52, "state": "file", "uid": 0} 2021-01-28T04:00:15.897 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.054) 0:00:35.961 ****** 2021-01-28T04:00:15.924 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2021-01-28T04:00:15.926 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:15.968 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:15 +0000 (0:00:00.071) 0:00:36.033 ****** 2021-01-28T04:00:17.146 INFO:teuthology.task.ansible.out: 2021-01-28T04:00:17.148 INFO:teuthology.task.ansible.out:TASK [testnode : Install apt keys] ********************************************* ok: [smithi150.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-28T04:00:17.158 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc"} 2021-01-28T04:00:18.111 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-28T04:00:18.112 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc"} 2021-01-28T04:00:18.151 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:18 +0000 (0:00:02.182) 0:00:38.215 ****** 2021-01-28T04:00:18.190 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:18 +0000 (0:00:00.038) 0:00:38.254 ****** 2021-01-28T04:00:18.806 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2021-01-28T04:00:18.807 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:00:18.847 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:18 +0000 (0:00:00.657) 0:00:38.911 ****** 2021-01-28T04:00:18.865 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:00:18.867 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2021-01-28T04:00:18.906 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:18 +0000 (0:00:00.059) 0:00:38.970 ****** 2021-01-28T04:00:18.947 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:18 +0000 (0:00:00.040) 0:00:39.011 ****** 2021-01-28T04:00:19.012 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:19 +0000 (0:00:00.064) 0:00:39.076 ****** 2021-01-28T04:00:19.071 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2021-01-28T04:00:19.073 INFO:teuthology.task.ansible.out:[WARNING]: Consider using 'become', 'become_method', and 'become_user' rather than running sudo changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.032881", "end": "2021-01-28 04:00:18.732194", "rc": 0, "start": "2021-01-28 04:00:18.699313", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:00:19.123 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:19 +0000 (0:00:00.111) 0:00:39.187 ****** 2021-01-28T04:00:19.173 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["sudo", "apt-get", "clean"], "delta": "0:00:00.029503", "end": "2021-01-28 04:00:19.525264", "rc": 0, "start": "2021-01-28 04:00:19.495761", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:00:19.210 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:19 +0000 (0:00:00.086) 0:00:39.274 ****** 2021-01-28T04:00:21.179 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2021-01-28T04:00:21.182 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:00:21.216 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:21 +0000 (0:00:02.006) 0:00:41.280 ****** 2021-01-28T04:00:21.423 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:00:21.461 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:21 +0000 (0:00:00.244) 0:00:41.525 ****** 2021-01-28T04:00:33.243 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-28T04:00:33.245 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-28T04:00:33.247 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-28T04:00:33.289 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:33 +0000 (0:00:11.828) 0:00:53.353 ****** 2021-01-28T04:00:33.953 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T04:00:33.955 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:00:34.001 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:33 +0000 (0:00:00.711) 0:00:54.065 ****** 2021-01-28T04:00:34.033 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-28T04:00:34.035 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:34.084 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:34 +0000 (0:00:00.083) 0:00:54.149 ****** 2021-01-28T04:00:34.178 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2021-01-28T04:00:34.180 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\nThe following packages were automatically installed and are no longer required:\n cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms\n libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1\n libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools\n ovmf qemu-system-data qemu-system-gui seabios sharutils\nUse 'sudo apt autoremove' to remove them.\nThe following packages will be REMOVED:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.\nAfter this operation, 62.6 MB disk space will be freed.\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading database ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150606 files and directories currently installed.)\r\nRemoving qemu-utils (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nRemoving qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nRemoving librbd1 (15.2.7-0ubuntu0.20.04.1) ...\r\nRemoving librados2 (15.2.7-0ubuntu0.20.04.1) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\ 2021-01-28T04:00:34.182 INFO:teuthology.task.ansible.out:r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "The following packages were automatically installed and are no longer required:", " cpu-checker ipxe-qemu ipxe-qemu-256k-compat-efi-roms", " libboost-iostreams1.71.0 libbrlapi0.7 libcacard0 libiscsi7 libpmem1", " libslirp0 libspice-server1 libusbredirparser1 libvirglrenderer1 msr-tools", " ovmf qemu-system-data qemu-system-gui seabios sharutils", "Use 'sudo apt autoremove' to remove them.", "The following packages will be REMOVED:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 0 newly installed, 6 to remove and 19 not upgraded.", "After this operation, 62.6 MB disk space will be freed.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150606 files and directories currently installed.)", "Removing qemu-utils (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Removing qemu-system-common (1:4.2-3ubuntu6.11) ...", "Removing qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Removing librbd1 (15.2.7-0ubuntu0.20.04.1) ...", "Removing librados2 (15.2.7-0ubuntu0.20.04.1) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-28T04:00:34.230 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:34 +0000 (0:00:00.145) 0:00:54.294 ****** 2021-01-28T04:00:34.922 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T04:00:34.923 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:00:34.962 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:34 +0000 (0:00:00.731) 0:00:55.026 ****** 2021-01-28T04:00:34.995 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2021-01-28T04:00:34.997 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:35.036 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:35 +0000 (0:00:00.073) 0:00:55.100 ****** 2021-01-28T04:00:43.416 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T04:00:43.417 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.6 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-28T04:00:43.419 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-28T04:00:43.420 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.6 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-28T04:00:43.422 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-28T04:00:43.454 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:43 +0000 (0:00:08.418) 0:01:03.518 ****** 2021-01-28T04:00:44.101 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:00:44.138 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:44 +0000 (0:00:00.684) 0:01:04.202 ****** 2021-01-28T04:00:44.271 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-28T04:00:44.273 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-28T04:00:44.307 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:44 +0000 (0:00:00.169) 0:01:04.372 ****** 2021-01-28T04:00:44.334 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-28T04:00:44.336 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:44.372 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:44 +0000 (0:00:00.064) 0:01:04.436 ****** 2021-01-28T04:00:44.526 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-28T04:00:44.528 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-28T04:00:44.563 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:44 +0000 (0:00:00.190) 0:01:04.627 ****** 2021-01-28T04:00:44.885 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-28T04:00:44.887 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-28T04:00:44.931 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:44 +0000 (0:00:00.367) 0:01:04.995 ****** 2021-01-28T04:00:44.962 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T04:00:44.963 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": true, "stderr": "W: --force-yes is deprecated, use one of the options starting with --allow instead.\n", "stderr_lines": ["W: --force-yes is deprecated, use one of the options starting with --allow instead."], "stdout": "Reading package lists...\nBuilding dependency tree...\nReading state information...\ngit is already the newest version (1:2.25.1-1ubuntu3).\nThe following additional packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils\nSuggested packages:\n samba vde2 debootstrap\nThe following NEW packages will be installed:\n librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86\n qemu-utils\n0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.\nNeed to get 13.6 MB of archives.\nAfter this operation, 62.6 MB of additional disk space will be used.\nGet:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]\nGet:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]\nGet:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]\nGet:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]\nGet:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]\nGet:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]\nFetched 13.6 MB in 1s (11.8 MB/s)\nSelecting previously unselected package librados2.\r\n(Reading database ... \r(Reading database ... 5%\r(Reading database ... 10%\r(Reading database ... 15%\r(Reading database ... 20%\r(Reading database ... 25%\r(Reading database ... 30%\r(Reading database ... 35%\r(Reading database ... 40%\r(Reading database ... 45%\r(Reading da 2021-01-28T04:00:44.965 INFO:teuthology.task.ansible.out:tabase ... 50%\r(Reading database ... 55%\r(Reading database ... 60%\r(Reading database ... 65%\r(Reading database ... 70%\r(Reading database ... 75%\r(Reading database ... 80%\r(Reading database ... 85%\r(Reading database ... 90%\r(Reading database ... 95%\r(Reading database ... 100%\r(Reading database ... 150534 files and directories currently installed.)\r\nPreparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package librbd1.\r\nPreparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...\r\nUnpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSelecting previously unselected package qemu-block-extra:amd64.\r\nPreparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-common.\r\nPreparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-system-x86.\r\nPreparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSelecting previously unselected package qemu-utils.\r\nPreparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...\r\nUnpacking qemu-utils (1:4.2-3ubuntu6.11) ...\r\nSetting up librados2 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...\r\nSetting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-common (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...\r\nSetting up qemu-utils (1:4.2-3ubuntu6.11) ...\r\nProcessing triggers for man-db (2.9.1-1) ...\r\nProcessing triggers for libc-bin (2.31-0ubuntu9.1) ...\r\n", "stdout_lines": ["Reading package lists...", "Building dependency tree...", "Reading state information...", "git is 2021-01-28T04:00:44.966 INFO:teuthology.task.ansible.out:already the newest version (1:2.25.1-1ubuntu3).", "The following additional packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-utils", "Suggested packages:", " samba vde2 debootstrap", "The following NEW packages will be installed:", " librados2 librbd1 qemu-block-extra qemu-system-common qemu-system-x86", " qemu-utils", "0 upgraded, 6 newly installed, 0 to remove and 19 not upgraded.", "Need to get 13.6 MB of archives.", "After this operation, 62.6 MB of additional disk space will be used.", "Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librados2 amd64 15.2.7-0ubuntu0.20.04.2 [3204 kB]", "Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 librbd1 amd64 15.2.7-0ubuntu0.20.04.2 [1609 kB]", "Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-block-extra amd64 1:4.2-3ubuntu6.11 [53.6 kB]", "Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-common amd64 1:4.2-3ubuntu6.11 [1055 kB]", "Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-system-x86 amd64 1:4.2-3ubuntu6.11 [6732 kB]", "Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 qemu-utils amd64 1:4.2-3ubuntu6.11 [972 kB]", "Fetched 13.6 MB in 1s (11.8 MB/s)", "Selecting previously unselected package librados2.", "(Reading database ... ", "(Reading database ... 5%", "(Reading database ... 10%", "(Reading database ... 15%", "(Reading database ... 20%", "(Reading database ... 25%", "(Reading database ... 30%", "(Reading database ... 35%", "(Reading database ... 40%", "(Reading database ... 45%", "(Reading database ... 50%", "(Reading database ... 55%", "(Reading database ... 60%", "(Reading database ... 65%", "(Reading database ... 70%", "(Reading database ... 75%", "(Reading database ... 80%", "(Reading database ... 85%", "(Reading database ... 90%", "(Reading database ... 95%", "(Reading database ... 100%", "(Reading database ... 150534 files and directories currently i 2021-01-28T04:00:44.968 INFO:teuthology.task.ansible.out:nstalled.)", "Preparing to unpack .../0-librados2_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package librbd1.", "Preparing to unpack .../1-librbd1_15.2.7-0ubuntu0.20.04.2_amd64.deb ...", "Unpacking librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Selecting previously unselected package qemu-block-extra:amd64.", "Preparing to unpack .../2-qemu-block-extra_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-common.", "Preparing to unpack .../3-qemu-system-common_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-common (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-system-x86.", "Preparing to unpack .../4-qemu-system-x86_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Selecting previously unselected package qemu-utils.", "Preparing to unpack .../5-qemu-utils_1%3a4.2-3ubuntu6.11_amd64.deb ...", "Unpacking qemu-utils (1:4.2-3ubuntu6.11) ...", "Setting up librados2 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up librbd1 (15.2.7-0ubuntu0.20.04.2) ...", "Setting up qemu-block-extra:amd64 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-common (1:4.2-3ubuntu6.11) ...", "Setting up qemu-system-x86 (1:4.2-3ubuntu6.11) ...", "Setting up qemu-utils (1:4.2-3ubuntu6.11) ...", "Processing triggers for man-db (2.9.1-1) ...", "Processing triggers for libc-bin (2.31-0ubuntu9.1) ..."]} 2021-01-28T04:00:45.011 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.080) 0:01:05.075 ****** 2021-01-28T04:00:45.092 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2021-01-28T04:00:45.094 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-28T04:00:45.139 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.127) 0:01:05.203 ****** 2021-01-28T04:00:45.282 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-28T04:00:45.284 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T04:00:45.318 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.178) 0:01:05.382 ****** 2021-01-28T04:00:45.591 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-28T04:00:45.592 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:59:10 UTC", "ActiveEnterTimestampMonotonic": "16577879", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target -.mount nss-lookup.target systemd-journald.socket systemd-tmpfiles-setup.service system.slice remote-fs.target basic.target network.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:59:10 UTC", "AssertTimestampMonotonic": "16023033", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:59:10 UTC", "ConditionTimestampMonotonic": "16023032", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-28T04:00:45.594 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1081", "ExecMainStartTimestamp": "Thu 2021-01-28 03:59:10 UTC", "ExecMainStartTimestampMonotonic": "16577849", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-28T04:00:45.596 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:59:10 UTC", "InactiveExitTimestampMonotonic": "16024048", "InvocationID": "179f74b5e60b4b8c833074010a7a8e76", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1081", "MemoryAccounting": "yes", "MemoryCurrent": "10223616", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2021-01-28T04:00:45.597 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:59:10 UTC", "StateChangeTimestampMonotonic": "16577879", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec" 2021-01-28T04:00:45.599 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T04:00:45.629 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.311) 0:01:05.693 ****** 2021-01-28T04:00:45.656 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-28T04:00:45.658 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install non aarch64 packages] ********************************* ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:00:45.694 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.064) 0:01:05.758 ****** 2021-01-28T04:00:45.730 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.036) 0:01:05.795 ****** 2021-01-28T04:00:45.738 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:45.785 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.054) 0:01:05.849 ****** 2021-01-28T04:00:45.812 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:45.848 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.062) 0:01:05.912 ****** 2021-01-28T04:00:45.865 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2021-01-28T04:00:45.867 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": ["perl", "-pe", "if (m{^([^#]\\S*\\s+/\\s+\\S+\\s+)(\\S+)(\\s+.*)$}) { $_=\"$1$2,user_xattr$3\\n\" unless $2=~m{(^|,)user_xattr(,|$)}; }", "-i.bak", "/etc/fstab"], "rc": 0, "stdout": "skipped, since /etc/fstab.bak exists", "stdout_lines": ["skipped, since /etc/fstab.bak exists"]} 2021-01-28T04:00:45.901 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.053) 0:01:05.965 ****** 2021-01-28T04:00:45.907 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-28T04:00:45.909 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:45.944 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.043) 0:01:06.009 ****** 2021-01-28T04:00:45.951 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2021-01-28T04:00:45.952 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:45.993 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:45 +0000 (0:00:00.048) 0:01:06.057 ****** 2021-01-28T04:00:46.000 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2021-01-28T04:00:46.001 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.039 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.046) 0:01:06.103 ****** 2021-01-28T04:00:46.067 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-28T04:00:46.068 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.104 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.064) 0:01:06.168 ****** 2021-01-28T04:00:46.122 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2021-01-28T04:00:46.123 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 10102, "name": "fuse", "state": "present", "system": false} 2021-01-28T04:00:46.163 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.059) 0:01:06.228 ****** 2021-01-28T04:00:46.171 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-28T04:00:46.173 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.214 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.050) 0:01:06.278 ****** 2021-01-28T04:00:46.242 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-28T04:00:46.244 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.282 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.067) 0:01:06.346 ****** 2021-01-28T04:00:46.308 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:00:46.310 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.344 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.062) 0:01:06.408 ****** 2021-01-28T04:00:46.372 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-28T04:00:46.374 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.410 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.065) 0:01:06.474 ****** 2021-01-28T04:00:46.437 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T04:00:46.439 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.479 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.068) 0:01:06.543 ****** 2021-01-28T04:00:46.507 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T04:00:46.510 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.543 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.064) 0:01:06.607 ****** 2021-01-28T04:00:46.550 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2021-01-28T04:00:46.552 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "9edff47031d0f14a9b8c813b44eb4a9296d0439f", "dest": "/etc/fuse.conf", "gid": 10102, "group": "fuse", "mode": "0644", "owner": "root", "path": "/etc/fuse.conf", "size": 366, "state": "file", "uid": 0} 2021-01-28T04:00:46.595 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.051) 0:01:06.659 ****** 2021-01-28T04:00:46.601 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-28T04:00:46.602 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.639 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.044) 0:01:06.703 ****** 2021-01-28T04:00:46.667 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T04:00:46.669 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.703 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.063) 0:01:06.767 ****** 2021-01-28T04:00:46.741 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T04:00:46.742 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.744 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ ok: [smithi150.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1238, "groups": "fuse,kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2021-01-28T04:00:46.783 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.080) 0:01:06.847 ****** 2021-01-28T04:00:46.819 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.035) 0:01:06.883 ****** 2021-01-28T04:00:46.824 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T04:00:46.826 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.864 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.045) 0:01:06.928 ****** 2021-01-28T04:00:46.894 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-28T04:00:46.896 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.932 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.067) 0:01:06.996 ****** 2021-01-28T04:00:46.949 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2021-01-28T04:00:46.951 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:46.990 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:46 +0000 (0:00:00.058) 0:01:07.055 ****** 2021-01-28T04:00:47.029 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.038) 0:01:07.093 ****** 2021-01-28T04:00:47.037 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-28T04:00:47.039 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.078 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.048) 0:01:07.142 ****** 2021-01-28T04:00:47.107 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T04:00:47.109 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.146 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.068) 0:01:07.210 ****** 2021-01-28T04:00:47.175 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T04:00:47.177 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.214 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.067) 0:01:07.278 ****** 2021-01-28T04:00:47.248 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T04:00:47.250 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.284 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.070) 0:01:07.348 ****** 2021-01-28T04:00:47.292 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2021-01-28T04:00:47.294 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "name": "apache2", "state": "stopped", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:59:15 UTC", "ActiveEnterTimestampMonotonic": "17018369", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "sysinit.target systemd-journald.socket nss-lookup.target basic.target network.target systemd-tmpfiles-setup.service -.mount system.slice remote-fs.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:59:14 UTC", "AssertTimestampMonotonic": "16135010", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:59:14 UTC", "ConditionTimestampMonotonic": "16135010", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ControlGroup" 2021-01-28T04:00:47.296 INFO:teuthology.task.ansible.out:: "/system.slice/apache2.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "The Apache HTTP Server", "DevicePolicy": "auto", "Documentation": "https://httpd.apache.org/docs/2.4/", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "Environment": "APACHE_STARTED_BY_SYSTEMD=true", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1069", "ExecMainStartTimestamp": "Thu 2021-01-28 03:59:15 UTC", "ExecMainStartTimestampMonotonic": "17018330", "ExecMainStatus": "0", "ExecReload": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl graceful ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl start ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStop": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStopEx": "{ path=/usr/sbin/apachectl ; argv[]=/usr/sbin/apachectl stop ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/apache2.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "1844674407370 2021-01-28T04:00:47.297 INFO:teuthology.task.ansible.out:9551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "apache2.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:59:14 UTC", "InactiveExitTimestampMonotonic": "16136106", "InvocationID": "bd9cf4afa5d04cea8d2ad36cf531e0a7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "1069", "MemoryAccounting": "yes", "MemoryCurrent": "10006528", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPol 2021-01-28T04:00:47.299 INFO:teuthology.task.ansible.out:icy": "n/a", "Names": "apache2.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/tmp /var/tmp", "Restart": "on-abort", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:59:15 UTC", "StateChangeTimestampMonotonic": "17018369", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "55", "TasksMax": "38334", "TimeoutAbortUSec" 2021-01-28T04:00:47.301 INFO:teuthology.task.ansible.out:: "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T04:00:47.332 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.048) 0:01:07.396 ****** 2021-01-28T04:00:47.340 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T04:00:47.342 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.378 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.046) 0:01:07.443 ****** 2021-01-28T04:00:47.386 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2021-01-28T04:00:47.387 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.421 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.042) 0:01:07.485 ****** 2021-01-28T04:00:47.427 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T04:00:47.428 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.463 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.042) 0:01:07.527 ****** 2021-01-28T04:00:47.469 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2021-01-28T04:00:47.471 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.505 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.041) 0:01:07.569 ****** 2021-01-28T04:00:47.510 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T04:00:47.512 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.548 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.042) 0:01:07.612 ****** 2021-01-28T04:00:47.554 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2021-01-28T04:00:47.555 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.590 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.042) 0:01:07.654 ****** 2021-01-28T04:00:47.597 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-28T04:00:47.599 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.635 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.045) 0:01:07.699 ****** 2021-01-28T04:00:47.642 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2021-01-28T04:00:47.643 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.680 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.045) 0:01:07.744 ****** 2021-01-28T04:00:47.708 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.767 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.086) 0:01:07.831 ****** 2021-01-28T04:00:47.775 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-28T04:00:47.777 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-28T04:00:47.824 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.056) 0:01:07.888 ****** 2021-01-28T04:00:47.831 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2021-01-28T04:00:47.834 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.872 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.048) 0:01:07.937 ****** 2021-01-28T04:00:47.910 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2021-01-28T04:00:47.913 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:47.946 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:47 +0000 (0:00:00.073) 0:01:08.011 ****** 2021-01-28T04:00:47.975 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2021-01-28T04:00:47.977 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.014 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.067) 0:01:08.078 ****** 2021-01-28T04:00:48.043 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:00:48.045 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.080 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.066) 0:01:08.144 ****** 2021-01-28T04:00:48.108 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2021-01-28T04:00:48.110 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.149 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.069) 0:01:08.214 ****** 2021-01-28T04:00:48.156 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-28T04:00:48.158 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-28T04:00:48.202 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.052) 0:01:08.266 ****** 2021-01-28T04:00:48.210 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2021-01-28T04:00:48.212 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.255 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.053) 0:01:08.319 ****** 2021-01-28T04:00:48.261 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-28T04:00:48.263 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.301 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.046) 0:01:08.365 ****** 2021-01-28T04:00:48.309 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2021-01-28T04:00:48.310 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.348 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.046) 0:01:08.412 ****** 2021-01-28T04:00:48.377 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-28T04:00:48.379 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.414 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.065) 0:01:08.478 ****** 2021-01-28T04:00:48.441 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T04:00:48.443 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.478 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.064) 0:01:08.542 ****** 2021-01-28T04:00:48.506 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T04:00:48.508 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.541 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.062) 0:01:08.605 ****** 2021-01-28T04:00:48.574 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T04:00:48.576 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.609 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.067) 0:01:08.673 ****** 2021-01-28T04:00:48.616 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2021-01-28T04:00:48.617 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-28T04:00:48.660 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.051) 0:01:08.724 ****** 2021-01-28T04:00:48.670 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-28T04:00:48.672 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.710 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.049) 0:01:08.774 ****** 2021-01-28T04:00:48.737 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.774 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.064) 0:01:08.838 ****** 2021-01-28T04:00:48.803 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2021-01-28T04:00:48.804 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.841 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.066) 0:01:08.905 ****** 2021-01-28T04:00:48.869 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T04:00:48.871 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.906 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.064) 0:01:08.970 ****** 2021-01-28T04:00:48.934 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T04:00:48.936 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:48.973 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:48 +0000 (0:00:00.067) 0:01:09.037 ****** 2021-01-28T04:00:48.991 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-28T04:00:48.993 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-28T04:00:49.027 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.054) 0:01:09.092 ****** 2021-01-28T04:00:49.035 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T04:00:49.037 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:49.073 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.045) 0:01:09.138 ****** 2021-01-28T04:00:49.101 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2021-01-28T04:00:49.103 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:49.137 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.063) 0:01:09.201 ****** 2021-01-28T04:00:49.165 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2021-01-28T04:00:49.166 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:49.204 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.066) 0:01:09.268 ****** 2021-01-28T04:00:49.233 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2021-01-28T04:00:49.235 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:49.270 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.066) 0:01:09.334 ****** 2021-01-28T04:00:49.306 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2021-01-28T04:00:49.308 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:49.364 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.094) 0:01:09.428 ****** 2021-01-28T04:00:49.373 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-28T04:00:49.374 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-28T04:00:49.415 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.051) 0:01:09.479 ****** 2021-01-28T04:00:49.496 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2021-01-28T04:00:49.497 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "path": "/etc/ceph", "state": "absent"} 2021-01-28T04:00:49.534 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.118) 0:01:09.598 ****** 2021-01-28T04:00:49.583 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-28T04:00:49.585 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T04:00:49.621 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.086) 0:01:09.685 ****** 2021-01-28T04:00:49.648 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-28T04:00:49.650 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:49.684 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.063) 0:01:09.748 ****** 2021-01-28T04:00:49.825 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 28 January 2021 04:00:49 +0000 (0:00:00.071) 0:01:09.819 ****** TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:49.829 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.073) 0:01:09.893 ****** 2021-01-28T04:00:49.858 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2021-01-28T04:00:49.860 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "0b949a4622a315acfc90571fddbd013b4dc0f5f9", "dest": "/etc/exports", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/exports", "size": 578, "state": "file", "uid": 0} 2021-01-28T04:00:49.906 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.076) 0:01:09.970 ****** 2021-01-28T04:00:49.913 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2021-01-28T04:00:49.916 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:49.952 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:49 +0000 (0:00:00.046) 0:01:10.017 ****** 2021-01-28T04:00:49.960 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2021-01-28T04:00:49.962 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.028 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.075) 0:01:10.092 ****** 2021-01-28T04:00:50.039 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-28T04:00:50.040 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.092 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.063) 0:01:10.156 ****** 2021-01-28T04:00:50.123 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:00:50.125 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-28T04:00:50.165 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.073) 0:01:10.229 ****** 2021-01-28T04:00:50.224 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-28T04:00:50.226 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.236 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.249 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.270 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.272 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-28T04:00:50.281 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.295 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.313 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.317 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.325 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.328 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.336 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.399 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.233) 0:01:10.463 ****** 2021-01-28T04:00:50.411 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "d5677bbd13857966eb0fc86f66195b18a2b98e20", "dest": "/etc/cron.weekly/kernel-clean", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/cron.weekly/kernel-clean", "size": 752, "state": "file", "uid": 0} 2021-01-28T04:00:50.465 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.065) 0:01:10.529 ****** 2021-01-28T04:00:50.717 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-28T04:00:50.719 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.017129", "end": "2021-01-28 04:00:50.688890", "rc": 0, "start": "2021-01-28 04:00:50.671761", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-28T04:00:50.761 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.296) 0:01:10.825 ****** 2021-01-28T04:00:50.809 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-28T04:00:50.811 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.850 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.089) 0:01:10.914 ****** 2021-01-28T04:00:50.857 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2021-01-28T04:00:50.859 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "22e9a1446f43d0440219b9af14a66dd77fb0c2eb", "dest": "/etc/grub.d/02_force_timeout", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/grub.d/02_force_timeout", "size": 115, "state": "file", "uid": 0} 2021-01-28T04:00:50.902 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.052) 0:01:10.967 ****** 2021-01-28T04:00:50.908 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-01-28T04:00:50.910 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:50.969 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:50 +0000 (0:00:00.066) 0:01:11.033 ****** 2021-01-28T04:00:51.019 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-28T04:00:51.021 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:51.055 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.086) 0:01:11.119 ****** 2021-01-28T04:00:51.260 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2021-01-28T04:00:51.265 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "6449466d762bced58744df80432d189e35329803", "dest": "/etc/modules", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/modules", "size": 315, "state": "file", "uid": 0} 2021-01-28T04:00:51.298 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.242) 0:01:11.362 ****** 2021-01-28T04:00:51.431 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2021-01-28T04:00:51.433 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T04:00:51.468 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.170) 0:01:11.532 ****** 2021-01-28T04:00:51.496 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2021-01-28T04:00:51.498 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:51.536 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.068) 0:01:11.601 ****** 2021-01-28T04:00:51.575 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2021-01-28T04:00:51.576 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:51.617 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.080) 0:01:11.681 ****** 2021-01-28T04:00:51.647 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2021-01-28T04:00:51.649 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:51.683 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.065) 0:01:11.747 ****** 2021-01-28T04:00:51.711 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-28T04:00:51.713 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:00:51.714 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:51.756 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.073) 0:01:11.820 ****** 2021-01-28T04:00:51.789 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.033) 0:01:11.853 ****** 2021-01-28T04:00:51.797 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-28T04:00:51.799 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:51.841 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.051) 0:01:11.905 ****** 2021-01-28T04:00:51.850 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2021-01-28T04:00:51.851 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:51.893 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.052) 0:01:11.957 ****** 2021-01-28T04:00:51.900 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-28T04:00:51.902 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item={'block_used': 13965215, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129893, 'size_available': 926228041728, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129893, "block_size": 4096, "block_total": 240095108, "block_used": 13965215, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228041728, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-28T04:00:51.941 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.048) 0:01:12.005 ****** 2021-01-28T04:00:51.949 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:00:51.951 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2021-01-28T04:00:51.990 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:51 +0000 (0:00:00.048) 0:01:12.054 ****** 2021-01-28T04:00:52.029 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-28T04:00:52.030 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=loop1) => {"ansible_loop_var": "item", "changed": false, "item": "loop1", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.040 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.051 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=loop6) => {"ansible_loop_var": "item", "changed": false, "item": "loop6", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.062 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=loop4) => {"ansible_loop_var": "item", "changed": false, "item": "loop4", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.064 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.073 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.084 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2021-01-28T04:00:52.086 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.008217", "end": "2021-01-28 04:00:51.750594", "rc": 0, "start": "2021-01-28 04:00:51.742377", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:00:52.123 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:52 +0000 (0:00:00.133) 0:01:12.187 ****** 2021-01-28T04:00:52.132 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2021-01-28T04:00:52.134 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=loop3) => {"ansible_loop_var": "item", "changed": false, "item": "loop3", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=loop2) => {"ansible_loop_var": "item", "changed": false, "item": "loop2", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.135 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=loop0) => {"ansible_loop_var": "item", "changed": false, "item": "loop0", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=loop7) => {"ansible_loop_var": "item", "changed": false, "item": "loop7", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.136 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=loop5) => {"ansible_loop_var": "item", "changed": false, "item": "loop5", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.136 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.191 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:52 +0000 (0:00:00.067) 0:01:12.255 ****** 2021-01-28T04:00:52.197 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-28T04:00:52.198 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'block_used': 13965215, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129893, 'size_available': 926228041728, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129893, "block_size": 4096, "block_total": 240095108, "block_used": 13965215, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228041728, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.240 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:52 +0000 (0:00:00.049) 0:01:12.304 ****** 2021-01-28T04:00:52.269 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-28T04:00:52.304 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:52 +0000 (0:00:00.064) 0:01:12.369 ****** 2021-01-28T04:00:52.363 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-28T04:00:52.365 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.406 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2021-01-28T04:00:52.408 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003565", "end": "2021-01-28 04:00:52.384800", "rc": 0, "start": "2021-01-28 04:00:52.381235", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2021-01-28T04:00:52.456 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:52 +0000 (0:00:00.146) 0:01:12.515 ****** 2021-01-28T04:00:52.491 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2021-01-28T04:00:52.493 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.534 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:52 +0000 (0:00:00.083) 0:01:12.598 ****** 2021-01-28T04:00:52.571 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2021-01-28T04:00:52.573 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.607 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:52 +0000 (0:00:00.073) 0:01:12.671 ****** 2021-01-28T04:00:52.634 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2021-01-28T04:00:52.636 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:52.670 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:52 +0000 (0:00:00.062) 0:01:12.734 ****** 2021-01-28T04:00:53.311 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2021-01-28T04:00:53.313 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:00:53.354 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:53 +0000 (0:00:00.684) 0:01:13.418 ****** 2021-01-28T04:00:53.383 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2021-01-28T04:00:53.384 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:53.421 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:53 +0000 (0:00:00.067) 0:01:13.485 ****** 2021-01-28T04:00:53.480 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-28T04:00:53.482 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item={'block_used': 13965214, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129894, 'size_available': 926228045824, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129894, "block_size": 4096, "block_total": 240095108, "block_used": 13965214, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228045824, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}} 2021-01-28T04:00:53.522 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:53 +0000 (0:00:00.100) 0:01:13.586 ****** 2021-01-28T04:00:53.688 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2021-01-28T04:00:53.689 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.009591", "end": "2021-01-28 04:00:54.038217", "rc": 0, "start": "2021-01-28 04:00:54.028626", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:00:53.729 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:53 +0000 (0:00:00.206) 0:01:13.793 ****** 2021-01-28T04:00:53.781 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2021-01-28T04:00:53.783 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'block_used': 13965214, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129894, 'size_available': 926228045824, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129894, "block_size": 4096, "block_total": 240095108, "block_used": 13965214, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228045824, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:53.818 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:53 +0000 (0:00:00.089) 0:01:13.882 ****** 2021-01-28T04:00:53.855 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2021-01-28T04:00:53.896 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:00:53 +0000 (0:00:00.077) 0:01:13.960 ****** 2021-01-28T04:00:53.945 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-28T04:00:53.946 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:54.270 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcsTuiwQZYX1mVZD3r13IKBYtmEzK2Bxbs'], 'uuids': ['fd22b54e-85bb-45fe-8e73-5872ab8aa007']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.772752", "end": "2021-01-28 04:00:53.921511", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcsTuiwQZYX1mVZD3r13IKBYtmEzK2Bxbs"], "labels": [], "masters": [], "uuids": ["fd22b54e-85bb-45fe-8e73-5872ab8aa007"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:52.148759", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:00:54.282 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:54.283 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:55.549 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcpk4odmYky4lFa43ethbpQQo99XYMzu2V'], 'uuids': ['ce05defa-1eec-462b-846a-3125e83f98a5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.138907", "end": "2021-01-28 04:00:55.201481", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcpk4odmYky4lFa43ethbpQQo99XYMzu2V"], "labels": [], "masters": [], "uuids": ["ce05defa-1eec-462b-846a-3125e83f98a5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:54.062574", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:00:55.561 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV', 'wwn-0x5000c50092941659'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1', 'wwn-0x5000c50092941659-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092941659', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XNGV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV", "wwn-0x5000c50092941659"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1", "wwn-0x5000c50092941659-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNGV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941659"}}, 2021-01-28T04:00:55.563 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-28T04:00:55.615 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJtAWodDQFMZonBsi0fxF58yEdgNlZcQFS'], 'uuids': ['9c25ae14-958c-4b9d-b675-4a62c29884b1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.537451", "end": "2021-01-28 04:00:55.957796", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJtAWodDQFMZonBsi0fxF58yEdgNlZcQFS"], "labels": [], "masters": [], "uuids": ["9c25ae14-958c-4b9d-b675-4a62c29884b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:54.420345", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:00:55.626 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:55.627 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:56.879 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-vOPxbi-a9eS-HPeW-6r81-5kqP-xVvm-ey57af', 'nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN', 'nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.189295", "end": "2021-01-28 04:00:56.529281", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vOPxbi-a9eS-HPeW-6r81-5kqP-xVvm-ey57af", "nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN", "nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:55.339986", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-28T04:00:56.881 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:00:56.892 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:56.895 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJv7X3UlHW0sP4Gj8sLBor3bYYZdmcUl1s'], 'uuids': ['5d4511fe-36fb-42ad-806a-f9650776af37']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.125738", "end": "2021-01-28 04:00:57.230979", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJv7X3UlHW0sP4Gj8sLBor3bYYZdmcUl1s"], "labels": [], "masters": [], "uuids": ["5d4511fe-36fb-42ad-806a-f9650776af37"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:56.105241", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:00:56.897 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME', 'wwn-0x5000c5009293e56f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME-part1', 'wwn-0x5000c5009293e56f-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293e56f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTME', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME", "wwn-0x5000c5009293e56f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME-part1", "wwn-0x5000c5009293e56f-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTME", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293e56f"}}, 2021-01-28T04:00:56.899 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-28T04:00:56.900 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:58.173 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-vOpVc0-8OUB-GNg5-sd7O-nM89-Hudk-tHf0Q5', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN', 'nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.145923", "end": "2021-01-28 04:00:58.513691", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vOpVc0-8OUB-GNg5-sd7O-nM89-Hudk-tHf0Q5", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN", "nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:57.367768", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nGPT data structures d 2021-01-28T04:00:58.175 INFO:teuthology.task.ansible.out:estroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:00:58.175 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcuz3Nz1xKuCO5uWk8DeNWGATMQEkrMkK7'], 'uuids': ['eac763dd-505f-4911-a925-67c90ddd3fe1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.155334", "end": "2021-01-28 04:00:57.826726", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcuz3Nz1xKuCO5uWk8DeNWGATMQEkrMkK7"], "labels": [], "masters": [], "uuids": ["eac763dd-505f-4911-a925-67c90ddd3fe1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:56.671392", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition 2021-01-28T04:00:58.177 INFO:teuthology.task.ansible.out:table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:58.189 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:58.190 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:58.203 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:59.447 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcjA3P3Rz9hT6Ueyj1bSaMcvHJc85HTSmh'], 'uuids': ['cf7f5d08-35cb-4614-9d70-8d8cc6dbd8f0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.122828", "end": "2021-01-28 04:00:59.094861", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcjA3P3Rz9hT6Ueyj1bSaMcvHJc85HTSmh"], "labels": [], "masters": [], "uuids": ["cf7f5d08-35cb-4614-9d70-8d8cc6dbd8f0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:57.972033", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:00:59.450 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:59.493 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJf5XtlVKN9wtxyr0om1VR7D4mrOPw97os'], 'uuids': ['0a9db805-8232-4e4e-8189-d9651b19d3b9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.174090", "end": "2021-01-28 04:00:59.838624", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJf5XtlVKN9wtxyr0om1VR7D4mrOPw97os"], "labels": [], "masters": [], "uuids": ["0a9db805-8232-4e4e-8189-d9651b19d3b9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:58.664534", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:00:59.505 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:00:59.517 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:00.734 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtce2yWxlGBklNH6RKATCHX7H8cCpJhKQO2'], 'uuids': ['7d1f42f5-40d2-4d3d-a854-e44c11e49bc3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.145442", "end": "2021-01-28 04:01:00.385803", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtce2yWxlGBklNH6RKATCHX7H8cCpJhKQO2"], "labels": [], "masters": [], "uuids": ["7d1f42f5-40d2-4d3d-a854-e44c11e49bc3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:59.240361", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:01:00.809 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:00 +0000 (0:00:06.912) 0:01:20.873 ****** 2021-01-28T04:01:00.833 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJzVlyCU1dy38X0ci8R8d2RnmlqU85LUm6'], 'uuids': ['28fbf7b8-34bf-40c2-8713-73a58530f180']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.179580", "end": "2021-01-28 04:01:01.163762", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJzVlyCU1dy38X0ci8R8d2RnmlqU85LUm6"], "labels": [], "masters": [], "uuids": ["28fbf7b8-34bf-40c2-8713-73a58530f180"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:00:59.984182", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:01:00.848 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:00.881 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-28T04:01:00.883 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:01.178 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcsTuiwQZYX1mVZD3r13IKBYtmEzK2Bxbs'], 'uuids': ['fd22b54e-85bb-45fe-8e73-5872ab8aa007']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.158166", "end": "2021-01-28 04:01:00.824676", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcsTuiwQZYX1mVZD3r13IKBYtmEzK2Bxbs"], "labels": [], "masters": [], "uuids": ["fd22b54e-85bb-45fe-8e73-5872ab8aa007"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:00.666510", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.155039 s, 744 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.155039 s, 744 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:01.189 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:01.190 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:01.496 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcpk4odmYky4lFa43ethbpQQo99XYMzu2V'], 'uuids': ['ce05defa-1eec-462b-846a-3125e83f98a5']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.177592", "end": "2021-01-28 04:01:01.146554", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcpk4odmYky4lFa43ethbpQQo99XYMzu2V"], "labels": [], "masters": [], "uuids": ["ce05defa-1eec-462b-846a-3125e83f98a5"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:00.968962", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.172745 s, 668 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.172745 s, 668 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:01.499 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV', 'wwn-0x5000c50092941659'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1', 'wwn-0x5000c50092941659-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c50092941659', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XNGV', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV", "wwn-0x5000c50092941659"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XNGV-part1", "wwn-0x5000c50092941659-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XNGV", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092941659"}}, 2021-01-28T04:01:01.501 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-28T04:01:01.681 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-vOPxbi-a9eS-HPeW-6r81-5kqP-xVvm-ey57af', 'nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN', 'nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.055175", "end": "2021-01-28 04:01:01.334412", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vOPxbi-a9eS-HPeW-6r81-5kqP-xVvm-ey57af", "nvme-INTEL_SSDPEDMD400G4_CVFT62420002400BGN", "nvme-nvme.8086-43564654363234323030303234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:01.279237", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0502554 s, 2.3 GB/s", "std 2021-01-28T04:01:01.683 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0502554 s, 2.3 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:01.705 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:01.707 INFO:teuthology.task.ansible.out: 2021-01-28T04:01:01.719 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:02.004 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcuz3Nz1xKuCO5uWk8DeNWGATMQEkrMkK7'], 'uuids': ['eac763dd-505f-4911-a925-67c90ddd3fe1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.157808", "end": "2021-01-28 04:01:01.656114", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcuz3Nz1xKuCO5uWk8DeNWGATMQEkrMkK7"], "labels": [], "masters": [], "uuids": ["eac763dd-505f-4911-a925-67c90ddd3fe1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:01.498306", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.154114 s, 748 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.154114 s, 748 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:02.006 INFO:teuthology.task.ansible.out: 2021-01-28T04:01:02.017 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:02.039 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:02.165 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2021-01-28T04:01:02.167 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJ3oSIYrcnXM6Q7ejsCPJ5gQsDdn0gFgix'], 'uuids': ['0dd32193-2019-40c6-b166-4c909b17f65e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.179035", "end": "2021-01-28 04:01:02.508690", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJ3oSIYrcnXM6Q7ejsCPJ5gQsDdn0gFgix"], "labels": [], "masters": [], "uuids": ["0dd32193-2019-40c6-b166-4c909b17f65e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:01.329655", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries in memory.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries in memory.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2021-01-28T04:01:02.212 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:02 +0000 (0:00:01.403) 0:01:22.276 ****** 2021-01-28T04:01:02.275 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-28T04:01:02.277 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop1', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop1", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:02.330 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcjA3P3Rz9hT6Ueyj1bSaMcvHJc85HTSmh'], 'uuids': ['cf7f5d08-35cb-4614-9d70-8d8cc6dbd8f0']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.162621", "end": "2021-01-28 04:01:01.981711", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtcjA3P3Rz9hT6Ueyj1bSaMcvHJc85HTSmh"], "labels": [], "masters": [], "uuids": ["cf7f5d08-35cb-4614-9d70-8d8cc6dbd8f0"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:01.819090", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.157801 s, 731 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.157801 s, 731 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:02.342 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:02.570 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJtAWodDQFMZonBsi0fxF58yEdgNlZcQFS'], 'uuids': ['9c25ae14-958c-4b9d-b675-4a62c29884b1']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.161034", "end": "2021-01-28 04:01:02.917235", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJtAWodDQFMZonBsi0fxF58yEdgNlZcQFS"], "labels": [], "masters": [], "uuids": ["9c25ae14-958c-4b9d-b675-4a62c29884b1"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:02.756201", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156238 s, 738 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156238 s, 738 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:02.581 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop6', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop6", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:02.593 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop4', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop4", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:02.636 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtce2yWxlGBklNH6RKATCHX7H8cCpJhKQO2'], 'uuids': ['7d1f42f5-40d2-4d3d-a854-e44c11e49bc3']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.173519", "end": "2021-01-28 04:01:02.290754", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-tMp3twkc2R3AB7HYFmki7WzFBlnSevtce2yWxlGBklNH6RKATCHX7H8cCpJhKQO2"], "labels": [], "masters": [], "uuids": ["7d1f42f5-40d2-4d3d-a854-e44c11e49bc3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:02.117235", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.16864 s, 684 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.16864 s, 684 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:02.683 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:02 +0000 (0:00:00.471) 0:01:22.747 ****** 2021-01-28T04:01:02.882 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJv7X3UlHW0sP4Gj8sLBor3bYYZdmcUl1s'], 'uuids': ['5d4511fe-36fb-42ad-806a-f9650776af37']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.163990", "end": "2021-01-28 04:01:03.230985", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJv7X3UlHW0sP4Gj8sLBor3bYYZdmcUl1s"], "labels": [], "masters": [], "uuids": ["5d4511fe-36fb-42ad-806a-f9650776af37"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:03.066995", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.159206 s, 724 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.159206 s, 724 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:02.896 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': 'ATA', 'sectors': '1953525168', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME', 'wwn-0x5000c5009293e56f'], 'uuids': []}, 'partitions': {'sda1': {'sectorsize': 512, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'links': {'masters': [], 'labels': [], 'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XTME-part1', 'wwn-0x5000c5009293e56f-part1'], 'uuids': ['ae02d76a-c1bf-47f7-9641-985fab1b2f70']}, 'sectors': '1953522688', 'start': '2048', 'holders': [], 'size': '931.51 GB'}}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'holders': [], 'wwn': '0x5000c5009293e56f', 'model': 'ST1000NM0033-9ZM', 'serial': 'Z1W5XTME', 'size': '931.51 GB'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME", "wwn-0x5000c5009293e56f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XTME-part1", "wwn-0x5000c5009293e56f-part1"], "labels": [], "masters": [], "uuids": ["ae02d76a-c1bf-47f7-9641-985fab1b2f70"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XTME", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c5009293e56f"}}, 2021-01-28T04:01:02.898 INFO:teuthology.task.ansible.out: "skip_reason": "Conditional result was False"} 2021-01-28T04:01:02.950 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-28T04:01:02.952 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.119950", "end": "2021-01-28 04:01:02.597122", "rc": 0, "start": "2021-01-28 04:01:02.477172", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:02.987 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:02 +0000 (0:00:00.303) 0:01:23.051 ****** 2021-01-28T04:01:03.078 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-28T04:01:03.079 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'scheduler_mode': 'none', 'rotational': '0', 'vendor': None, 'sectors': '781422768', 'links': {'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4'], 'labels': [], 'ids': ['lvm-pv-uuid-vOpVc0-8OUB-GNg5-sd7O-nM89-Hudk-tHf0Q5', 'nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN', 'nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': 'INTEL SSDPEDMD400G4', 'partitions': {}, 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4'], 'size': '372.61 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.059406", "end": "2021-01-28 04:01:03.421555", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-vOpVc0-8OUB-GNg5-sd7O-nM89-Hudk-tHf0Q5", "nvme-INTEL_SSDPEDMD400G4_CVFT623300GX400BGN", "nvme-nvme.8086-43564654363233333030475834303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:03.362149", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0546107 s, 2.1 GB/s", "std 2021-01-28T04:01:03.081 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0546107 s, 2.1 GB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:03.091 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop3', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop3", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.092 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop2', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop2", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.219 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-28T04:01:03.221 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.096585", "end": "2021-01-28 04:01:02.877904", "rc": 0, "start": "2021-01-28 04:01:02.781319", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:03.262 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.275) 0:01:23.327 ****** 2021-01-28T04:01:03.290 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-28T04:01:03.328 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.065) 0:01:23.392 ****** 2021-01-28T04:01:03.356 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-28T04:01:03.357 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.396 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.067) 0:01:23.460 ****** 2021-01-28T04:01:03.403 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-28T04:01:03.405 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '31252480', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJf5XtlVKN9wtxyr0om1VR7D4mrOPw97os'], 'uuids': ['0a9db805-8232-4e4e-8189-d9651b19d3b9']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '14.90 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.168416", "end": "2021-01-28 04:01:03.738882", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJf5XtlVKN9wtxyr0om1VR7D4mrOPw97os"], "labels": [], "masters": [], "uuids": ["0a9db805-8232-4e4e-8189-d9651b19d3b9"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:03.570466", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.162989 s, 708 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.162989 s, 708 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:03.416 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop0', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop0", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.417 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop7', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop7", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.428 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.463 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.067) 0:01:23.527 ****** 2021-01-28T04:01:03.490 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-28T04:01:03.492 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.527 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.064) 0:01:23.592 ****** 2021-01-28T04:01:03.555 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-28T04:01:03.556 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.591 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.063) 0:01:23.655 ****** 2021-01-28T04:01:03.708 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-28T04:01:03.710 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJzVlyCU1dy38X0ci8R8d2RnmlqU85LUm6'], 'uuids': ['28fbf7b8-34bf-40c2-8713-73a58530f180']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.167971", "end": "2021-01-28 04:01:04.048172", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJzVlyCU1dy38X0ci8R8d2RnmlqU85LUm6"], "labels": [], "masters": [], "uuids": ["28fbf7b8-34bf-40c2-8713-73a58530f180"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:03.880201", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.163103 s, 707 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.163103 s, 707 MB/s"], "stdout": "", "stdout_lines": []} skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'loop5', 'value': {'scheduler_mode': 'mq-deadline', 'rotational': '1', 'vendor': None, 'sectors': '0', 'links': {'masters': [], 'labels': [], 'ids': [], 'uuids': []}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '0', 'model': None, 'partitions': {}, 'holders': [], 2021-01-28T04:01:03.711 INFO:teuthology.task.ansible.out:'size': '0.00 Bytes'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "loop5", "value": {"holders": [], "host": "", "links": {"ids": [], "labels": [], "masters": [], "uuids": []}, "model": null, "partitions": {}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "0", "sectorsize": "512", "size": "0.00 Bytes", "support_discard": "0", "vendor": null, "virtual": 1}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.742 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-28T04:01:03.744 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T04:01:03.786 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.195) 0:01:23.850 ****** 2021-01-28T04:01:03.838 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-28T04:01:03.840 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'block_used': 13965215, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129893, 'size_available': 926228041728, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129893, "block_size": 4096, "block_total": 240095108, "block_used": 13965215, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228041728, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.880 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.094) 0:01:23.944 ****** 2021-01-28T04:01:03.924 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:03.963 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:03 +0000 (0:00:00.083) 0:01:24.027 ****** 2021-01-28T04:01:04.005 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2021-01-28T04:01:04.006 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'scheduler_mode': '', 'rotational': '0', 'vendor': None, 'sectors': '187490304', 'links': {'masters': [], 'labels': [], 'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJ3oSIYrcnXM6Q7ejsCPJ5gQsDdn0gFgix'], 'uuids': ['0dd32193-2019-40c6-b166-4c909b17f65e']}, 'sas_device_handle': None, 'sas_address': None, 'virtual': 1, 'host': '', 'sectorsize': '512', 'removable': '0', 'support_discard': '512', 'model': None, 'partitions': {}, 'holders': [], 'size': '89.40 GB'}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.161607", "end": "2021-01-28 04:01:04.347662", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-JzYn04cB3sUue6K7z4XjetRsBMFRjorJ3oSIYrcnXM6Q7ejsCPJ5gQsDdn0gFgix"], "labels": [], "masters": [], "uuids": ["0dd32193-2019-40c6-b166-4c909b17f65e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2021-01-28 04:01:04.186055", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.156784 s, 736 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.156784 s, 736 MB/s"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:04.021 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:04.024 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:04.061 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.097) 0:01:24.125 ****** 2021-01-28T04:01:04.102 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.041) 0:01:24.166 ****** 2021-01-28T04:01:04.110 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:04.112 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:04.162 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.059) 0:01:24.226 ****** 2021-01-28T04:01:04.193 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-28T04:01:04.195 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:04.230 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.067) 0:01:24.294 ****** 2021-01-28T04:01:04.267 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-28T04:01:04.269 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:04.307 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.077) 0:01:24.371 ****** 2021-01-28T04:01:04.345 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-28T04:01:04.347 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:04.381 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.073) 0:01:24.445 ****** 2021-01-28T04:01:04.387 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2021-01-28T04:01:04.389 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.140720", "end": "2021-01-28 04:01:04.725799", "rc": 0, "start": "2021-01-28 04:01:04.585079", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:04.429 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.047) 0:01:24.493 ****** 2021-01-28T04:01:04.649 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2021-01-28T04:01:04.650 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.079055", "end": "2021-01-28 04:01:04.998545", "rc": 0, "start": "2021-01-28 04:01:04.919490", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:04.685 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.256) 0:01:24.749 ****** 2021-01-28T04:01:04.712 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2021-01-28T04:01:04.750 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.064) 0:01:24.814 ****** 2021-01-28T04:01:04.777 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2021-01-28T04:01:04.779 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:04.815 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.065) 0:01:24.879 ****** 2021-01-28T04:01:04.841 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2021-01-28T04:01:04.843 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:04.883 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.067) 0:01:24.947 ****** 2021-01-28T04:01:04.913 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-28T04:01:04.915 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:04.963 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:04 +0000 (0:00:00.079) 0:01:25.027 ****** 2021-01-28T04:01:04.991 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2021-01-28T04:01:04.993 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:05.026 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.063) 0:01:25.091 ****** 2021-01-28T04:01:05.157 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2021-01-28T04:01:05.159 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2021-01-28T04:01:05.193 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.166) 0:01:25.257 ****** 2021-01-28T04:01:05.240 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2021-01-28T04:01:05.242 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'block_used': 13965214, 'uuid': 'ae02d76a-c1bf-47f7-9641-985fab1b2f70', 'size_total': 983429562368, 'block_total': 240095108, 'mount': '/', 'block_available': 226129894, 'size_available': 926228045824, 'fstype': 'ext4', 'inode_total': 61054976, 'options': 'rw,relatime,errors=remount-ro', 'device': '/dev/sda1', 'inode_used': 165091, 'block_size': 4096, 'inode_available': 60889885}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 226129894, "block_size": 4096, "block_total": 240095108, "block_used": 13965214, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60889885, "inode_total": 61054976, "inode_used": 165091, "mount": "/", "options": "rw,relatime,errors=remount-ro", "size_available": 926228045824, "size_total": 983429562368, "uuid": "ae02d76a-c1bf-47f7-9641-985fab1b2f70"}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:05.277 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.084) 0:01:25.341 ****** 2021-01-28T04:01:05.284 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-28T04:01:05.285 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-28T04:01:05.325 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.048) 0:01:25.390 ****** 2021-01-28T04:01:05.332 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2021-01-28T04:01:05.333 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:05.370 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.044) 0:01:25.434 ****** 2021-01-28T04:01:05.396 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:05.398 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:05.440 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.070) 0:01:25.504 ****** 2021-01-28T04:01:05.635 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:05.642 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:05.692 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.251) 0:01:25.756 ****** 2021-01-28T04:01:05.731 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2021-01-28T04:01:05.733 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:05.772 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.079) 0:01:25.836 ****** 2021-01-28T04:01:05.813 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2021-01-28T04:01:05.815 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:05.854 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.081) 0:01:25.918 ****** 2021-01-28T04:01:05.882 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2021-01-28T04:01:05.884 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:05.921 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:05 +0000 (0:00:00.067) 0:01:25.985 ****** 2021-01-28T04:01:06.067 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-28T04:01:06.069 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:06.435 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:06.519 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2021-01-28T04:01:06.521 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2021-01-28T04:01:06.575 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:06 +0000 (0:00:00.654) 0:01:26.639 ****** 2021-01-28T04:01:06.865 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-28T04:01:06.867 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:07.035 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:07.255 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:07.404 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:07.672 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:07.712 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:07 +0000 (0:00:01.137) 0:01:27.776 ****** 2021-01-28T04:01:07.805 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:07.849 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-28T04:01:07.851 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-28T04:01:07.892 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:07 +0000 (0:00:00.179) 0:01:27.956 ****** 2021-01-28T04:01:08.057 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-28T04:01:08.059 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T04:01:08.174 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T04:01:08.196 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-28T04:01:08.198 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:08.290 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-28T04:01:08.292 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T04:01:08.406 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T04:01:08.418 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:08.479 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:08 +0000 (0:00:00.587) 0:01:28.544 ****** 2021-01-28T04:01:08.513 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-28T04:01:08.514 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:08.550 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:08 +0000 (0:00:00.070) 0:01:28.614 ****** 2021-01-28T04:01:08.578 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2021-01-28T04:01:08.584 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2021-01-28T04:01:08.586 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-28T04:01:08.588 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:08.622 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:08 +0000 (0:00:00.071) 0:01:28.686 ****** 2021-01-28T04:01:08.666 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:08 +0000 (0:00:00.044) 0:01:28.731 ****** 2021-01-28T04:01:08.761 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-28T04:01:08.763 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:01:08.803 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:08 +0000 (0:00:00.136) 0:01:28.867 ****** 2021-01-28T04:01:08.822 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2021-01-28T04:01:08.824 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2021-01-28T04:01:08.860 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:08 +0000 (0:00:00.057) 0:01:28.924 ****** 2021-01-28T04:01:08.866 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-28T04:01:08.868 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-28T04:01:08.905 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:08 +0000 (0:00:00.044) 0:01:28.969 ****** 2021-01-28T04:01:09.007 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2021-01-28T04:01:09.009 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T04:01:09.191 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T04:01:09.296 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T04:01:09.414 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2021-01-28T04:01:09.425 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:09.471 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:09 +0000 (0:00:00.565) 0:01:29.535 ****** 2021-01-28T04:01:09.508 INFO:teuthology.task.ansible.out: TASK [testnode : Create filesystems] ******************************************* 2021-01-28T04:01:09.510 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:09.549 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:09 +0000 (0:00:00.078) 0:01:29.613 ****** 2021-01-28T04:01:09.576 INFO:teuthology.task.ansible.out: TASK [testnode : Mount filesystems] ******************************************** 2021-01-28T04:01:09.578 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:09.614 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:09 +0000 (0:00:00.065) 0:01:29.678 ****** 2021-01-28T04:01:09.756 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2021-01-28T04:01:09.758 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:01:09.793 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:09 +0000 (0:00:00.178) 0:01:29.857 ****** 2021-01-28T04:01:09.832 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2021-01-28T04:01:09.834 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2021-01-28T04:01:09.889 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:09 +0000 (0:00:00.096) 0:01:29.954 ****** 2021-01-28T04:01:10.154 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi150.front.sepia.ceph.com] => {"changed": true} 2021-01-28T04:01:10.192 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:10 +0000 (0:00:00.302) 0:01:30.256 ****** 2021-01-28T04:01:10.444 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true} 2021-01-28T04:01:10.496 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:10 +0000 (0:00:00.303) 0:01:30.560 ****** 2021-01-28T04:01:10.716 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2021-01-28T04:01:10.718 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-28T04:01:10.752 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:10 +0000 (0:00:00.256) 0:01:30.816 ****** 2021-01-28T04:01:10.758 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2021-01-28T04:01:10.800 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:10 +0000 (0:00:00.048) 0:01:30.865 ****** 2021-01-28T04:01:10.807 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd] ****************************************** 2021-01-28T04:01:10.809 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:10.847 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:10 +0000 (0:00:00.046) 0:01:30.911 ****** 2021-01-28T04:01:10.856 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:10.903 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:10 +0000 (0:00:00.056) 0:01:30.967 ****** 2021-01-28T04:01:10.913 INFO:teuthology.task.ansible.out: TASK [testnode : Install cachefilesd conf file] ******************************** 2021-01-28T04:01:10.915 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:10.959 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:10 +0000 (0:00:00.056) 0:01:31.023 ****** 2021-01-28T04:01:10.967 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:11.005 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:10 +0000 (0:00:00.045) 0:01:31.069 ****** 2021-01-28T04:01:11.011 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-28T04:01:11.013 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:11.049 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:11 +0000 (0:00:00.043) 0:01:31.113 ****** 2021-01-28T04:01:11.055 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:11.092 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:11 +0000 (0:00:00.043) 0:01:31.156 ****** 2021-01-28T04:01:11.099 INFO:teuthology.task.ansible.out: TASK [testnode : Restart cachefilesd] ****************************************** 2021-01-28T04:01:11.101 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:11.137 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:11 +0000 (0:00:00.045) 0:01:31.202 ****** 2021-01-28T04:01:11.343 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Thursday 28 January 2021 04:01:11 +0000 (0:00:00.045) 0:01:31.247 ****** TASK [testnode : Add CPAN config directory for the teuthology user.] *********** ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-28T04:01:11.373 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:11 +0000 (0:00:00.189) 0:01:31.437 ****** 2021-01-28T04:01:11.380 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 1000} 2021-01-28T04:01:11.421 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:11 +0000 (0:00:00.048) 0:01:31.485 ****** 2021-01-28T04:01:11.524 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2021-01-28T04:01:11.526 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:01:11.571 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:11 +0000 (0:00:00.150) 0:01:31.635 ****** 2021-01-28T04:01:11.578 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:01:11.634 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:11 +0000 (0:00:00.063) 0:01:31.698 ****** 2021-01-28T04:01:11.929 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2021-01-28T04:01:11.931 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-28T04:01:11.977 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:11 +0000 (0:00:00.343) 0:01:32.041 ****** 2021-01-28T04:01:11.985 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "gid": 1238, "group": "ubuntu", "mode": "0755", "owner": "ubuntu", "path": "/home/ubuntu/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 1000} 2021-01-28T04:01:12.032 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:12 +0000 (0:00:00.054) 0:01:32.096 ****** 2021-01-28T04:01:12.321 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2021-01-28T04:01:12.323 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-28T04:01:12.362 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:12 +0000 (0:00:00.330) 0:01:32.427 ****** 2021-01-28T04:01:12.369 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "dcd55d202d82b6e06d0555630d7a8b92d7100c36", "dest": "/root/.cpan/CPAN/MyConfig.pm", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/root/.cpan/CPAN/MyConfig.pm", "size": 2117, "state": "file", "uid": 0} 2021-01-28T04:01:12.412 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:12 +0000 (0:00:00.049) 0:01:32.476 ****** 2021-01-28T04:01:13.019 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2021-01-28T04:01:13.021 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:01:13.057 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:13 +0000 (0:00:00.644) 0:01:33.121 ****** 2021-01-28T04:01:13.075 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:01:13.111 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:13 +0000 (0:00:00.054) 0:01:33.176 ****** 2021-01-28T04:01:13.327 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2021-01-28T04:01:13.329 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.121847", "end": "2021-01-28 04:01:13.677937", "rc": 0, "start": "2021-01-28 04:01:13.556090", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-28T04:01:13.366 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:13 +0000 (0:00:00.254) 0:01:33.430 ****** 2021-01-28T04:01:13.389 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": ["perldoc", "-l", "Amazon::S3"], "delta": "0:00:00.118189", "end": "2021-01-28 04:01:13.028010", "rc": 0, "start": "2021-01-28 04:01:12.909821", "stderr": "", "stderr_lines": [], "stdout": "/usr/local/share/perl/5.30.0/Amazon/S3.pm", "stdout_lines": ["/usr/local/share/perl/5.30.0/Amazon/S3.pm"]} 2021-01-28T04:01:13.431 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:13 +0000 (0:00:00.065) 0:01:33.496 ****** 2021-01-28T04:01:13.440 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2021-01-28T04:01:13.441 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:13.477 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:13 +0000 (0:00:00.045) 0:01:33.541 ****** 2021-01-28T04:01:13.484 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:13.523 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:13 +0000 (0:00:00.045) 0:01:33.587 ****** 2021-01-28T04:01:13.532 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2021-01-28T04:01:13.534 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:13.570 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:13 +0000 (0:00:00.046) 0:01:33.634 ****** 2021-01-28T04:01:13.590 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:13.636 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:13 +0000 (0:00:00.066) 0:01:33.701 ****** 2021-01-28T04:01:14.212 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-28T04:01:14.214 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:01:14.251 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:14 +0000 (0:00:00.614) 0:01:34.315 ****** 2021-01-28T04:01:14.278 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2021-01-28T04:01:14.280 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:14.338 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:14 +0000 (0:00:00.086) 0:01:34.402 ****** 2021-01-28T04:01:14.348 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2021-01-28T04:01:14.349 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:01:14.385 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:14 +0000 (0:00:00.047) 0:01:34.450 ****** 2021-01-28T04:01:14.424 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:14.463 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:14 +0000 (0:00:00.077) 0:01:34.528 ****** 2021-01-28T04:01:14.666 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-28T04:01:14.668 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-28T04:01:14.706 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:14 +0000 (0:00:00.242) 0:01:34.770 ****** 2021-01-28T04:01:14.733 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-28T04:01:14.735 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:14.768 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:14 +0000 (0:00:00.062) 0:01:34.832 ****** 2021-01-28T04:01:14.787 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2021-01-28T04:01:14.789 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "size": 2767, "state": "file", "uid": 0} 2021-01-28T04:01:14.823 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:14 +0000 (0:00:00.054) 0:01:34.887 ****** 2021-01-28T04:01:14.853 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2021-01-28T04:01:14.855 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:14.888 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:14 +0000 (0:00:00.065) 0:01:34.952 ****** 2021-01-28T04:01:14.969 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-28T04:01:14.970 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:59:13 UTC", "ActiveEnterTimestampMonotonic": "15491525", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target system.slice sysinit.target systemd-tmpfiles-setup.service network.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:59:13 UTC", "AssertTimestampMonotonic": "15186934", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:59:13 UTC", "ConditionTimestampMonotonic": "15186933", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target", "ControlGroup": 2021-01-28T04:01:14.972 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "882", "ExecMainStartTimestamp": "Thu 2021-01-28 03:59:13 UTC", "ExecMainStartTimestampMonotonic": "15491504", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:59:13 UTC", "InactiveExitTimestampMonotonic": "15188355", "InvocationID": "98ef03cfa3824978af20ee7726f13c2d", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-28T04:01:14.973 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "882", "MemoryAccounting": "yes", "MemoryCurrent": "3555328", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "Requi 2021-01-28T04:01:14.975 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:59:13 UTC", "StateChangeTimestampMonotonic": "15491525", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T04:01:15.008 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:15 +0000 (0:00:00.119) 0:01:35.072 ****** 2021-01-28T04:01:15.035 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:15.037 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-28T04:01:15.095 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:15 +0000 (0:00:00.087) 0:01:35.159 ****** 2021-01-28T04:01:15.112 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2021-01-28T04:01:15.114 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "ntp", "state": "started", "status": {"ActiveEnterTimestamp": "Thu 2021-01-28 03:59:08 UTC", "ActiveEnterTimestampMonotonic": "14661120", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount systemd-journald.socket network.target system.slice basic.target sysinit.target systemd-tmpfiles-setup.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Thu 2021-01-28 03:59:08 UTC", "AssertTimestampMonotonic": "14330988", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Thu 2021-01-28 03:59:08 UTC", "ConditionTimestampMonotonic": "14330986", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target systemd-timesyncd.service", "ControlGroup": 2021-01-28T04:01:15.116 INFO:teuthology.task.ansible.out: "/system.slice/ntp.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "Documentation": "man:ntpd(8)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "876", "ExecMainStartTimestamp": "Thu 2021-01-28 03:59:08 UTC", "ExecMainStartTimestampMonotonic": "14661105", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/lib/ntp/ntp-systemd-wrapper ; argv[]=/usr/lib/ntp/ntp-systemd-wrapper ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/ntp.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "ntp.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Thu 2021-01-28 03:59:08 UTC", "InactiveExitTimestampMonotonic": "14331946", "InvocationID": "1c027af8295248d7844d6dbf6f1470a5", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "Lim 2021-01-28T04:01:15.117 INFO:teuthology.task.ansible.out:itCORESoft": "0", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "524288", "LimitNOFILESoft": "1024", "LimitNPROC": "127781", "LimitNPROCSoft": "127781", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "876", "MemoryAccounting": "yes", "MemoryCurrent": "3698688", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "ntp.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMPolicy": "stop", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "Requi 2021-01-28T04:01:15.119 INFO:teuthology.task.ansible.out:resMountsFor": "/tmp /var/tmp", "Restart": "no", "RestartKillSignal": "15", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 03:59:08 UTC", "StateChangeTimestampMonotonic": "14661120", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "2", "TasksMax": "38334", "TimeoutAbortUSec": "1min 30s", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T04:01:15.155 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:15 +0000 (0:00:00.060) 0:01:35.220 ****** 2021-01-28T04:01:15.163 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:15.165 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-28T04:01:15.205 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:15 +0000 (0:00:00.049) 0:01:35.269 ****** 2021-01-28T04:01:15.214 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:15.215 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2021-01-28T04:01:15.254 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:15 +0000 (0:00:00.048) 0:01:35.318 ****** 2021-01-28T04:01:15.262 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-28T04:01:15.263 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:15.302 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:15 +0000 (0:00:00.047) 0:01:35.366 ****** 2021-01-28T04:01:15.308 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:15.309 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2021-01-28T04:01:15.346 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:15 +0000 (0:00:00.044) 0:01:35.410 ****** 2021-01-28T04:01:15.373 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2021-01-28T04:01:15.375 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:15.416 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:15 +0000 (0:00:00.069) 0:01:35.480 ****** 2021-01-28T04:01:16.549 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-28T04:01:16.551 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:01:16.602 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:16 +0000 (0:00:01.186) 0:01:36.666 ****** 2021-01-28T04:01:16.642 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-28T04:01:16.648 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:16.692 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:16 +0000 (0:00:00.089) 0:01:36.756 ****** 2021-01-28T04:01:16.698 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2021-01-28T04:01:16.700 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:01:16.739 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:16 +0000 (0:00:00.046) 0:01:36.803 ****** 2021-01-28T04:01:16.778 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2021-01-28T04:01:16.781 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:16.820 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:16 +0000 (0:00:00.081) 0:01:36.885 ****** 2021-01-28T04:01:16.894 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2021-01-28T04:01:16.896 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-28T04:01:16.946 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:16 +0000 (0:00:00.125) 0:01:37.010 ****** 2021-01-28T04:01:17.026 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "size": 4096, "state": "directory", "uid": 1000} 2021-01-28T04:01:17.066 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:17 +0000 (0:00:00.120) 0:01:37.130 ****** 2021-01-28T04:01:17.428 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2021-01-28T04:01:17.430 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-28T04:01:17.467 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:17 +0000 (0:00:00.400) 0:01:37.531 ****** 2021-01-28T04:01:17.553 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1238, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "size": 73, "state": "file", "uid": 1000} 2021-01-28T04:01:17.609 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:17 +0000 (0:00:00.141) 0:01:37.673 ****** 2021-01-28T04:01:20.192 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2021-01-28T04:01:20.194 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-28T04:01:20.233 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:20 +0000 (0:00:02.624) 0:01:40.297 ****** 2021-01-28T04:01:20.432 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "cmd": ["/usr/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "", "stderr_lines": [], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)\nRequirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.8/dist-packages (1.2.0)", "Requirement already satisfied: execnet in /usr/local/lib/python3.8/dist-packages (from remoto>=0.0.35) (1.7.1)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.8/dist-packages (from execnet->remoto>=0.0.35) (1.5)"], "version": null, "virtualenv": null} 2021-01-28T04:01:20.473 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:20 +0000 (0:00:00.239) 0:01:40.537 ****** 2021-01-28T04:01:20.767 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-28T04:01:20.769 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false} 2021-01-28T04:01:20.815 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:20 +0000 (0:00:00.342) 0:01:40.879 ****** 2021-01-28T04:01:20.844 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-28T04:01:20.846 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-28T04:01:20.893 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:20 +0000 (0:00:00.077) 0:01:40.957 ****** 2021-01-28T04:01:20.996 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2021-01-28T04:01:20.997 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false} 2021-01-28T04:01:21.039 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:21 +0000 (0:00:00.145) 0:01:41.103 ****** 2021-01-28T04:01:21.067 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2021-01-28T04:01:21.069 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2021-01-28T04:01:21.107 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:21 +0000 (0:00:00.068) 0:01:41.171 ****** 2021-01-28T04:01:21.118 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2021-01-28T04:01:21.119 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611806092.5606604, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611806092.5566604, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611806092.5566604, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-28T04:01:21.160 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:21 +0000 (0:00:00.052) 0:01:41.224 ****** 2021-01-28T04:01:21.310 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "stat": {"atime": 1611806107.8316922, "attr_flags": "e", "attributes": ["extents"], "block_size": 4096, "blocks": 8, "charset": "us-ascii", "ctime": 1611806107.827692, "dev": 2049, "device_type": 0, "executable": false, "exists": true, "gid": 0, "gr_name": "root", "inode": 67510, "isblk": false, "ischr": false, "isdir": false, "isfifo": false, "isgid": false, "islnk": false, "isreg": true, "issock": false, "isuid": false, "mimetype": "text/plain", "mode": "0644", "mtime": 1611806107.827692, "nlink": 1, "path": "/etc/network/interfaces", "pw_name": "root", "readable": true, "rgrp": true, "roth": true, "rusr": true, "size": 71, "uid": 0, "version": "1828121574", "wgrp": false, "woth": false, "writeable": true, "wusr": true, "xgrp": false, "xoth": false, "xusr": false}} 2021-01-28T04:01:21.355 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:21 +0000 (0:00:00.194) 0:01:41.419 ****** 2021-01-28T04:01:21.667 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2021-01-28T04:01:21.669 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-28T04:01:21.703 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:21 +0000 (0:00:00.347) 0:01:41.767 ****** 2021-01-28T04:01:21.710 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "msg": ""} 2021-01-28T04:01:21.754 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:21 +0000 (0:00:00.051) 0:01:41.819 ****** 2021-01-28T04:01:21.762 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2021-01-28T04:01:21.765 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-28T04:01:21.807 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:21 +0000 (0:00:00.052) 0:01:41.871 ****** 2021-01-28T04:01:21.956 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2021-01-28T04:01:21.994 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:21 +0000 (0:00:00.187) 0:01:42.058 ****** 2021-01-28T04:01:22.001 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2021-01-28T04:01:22.003 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.045 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.050) 0:01:42.109 ****** 2021-01-28T04:01:22.053 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.106 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.062) 0:01:42.171 ****** 2021-01-28T04:01:22.236 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2021-01-28T04:01:22.238 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-28T04:01:22.294 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.187) 0:01:42.358 ****** 2021-01-28T04:01:22.312 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2021-01-28T04:01:22.363 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.068) 0:01:42.427 ****** 2021-01-28T04:01:22.479 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2021-01-28T04:01:22.481 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-28T04:01:22.516 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.152) 0:01:42.580 ****** 2021-01-28T04:01:22.550 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-28T04:01:22.552 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi150.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2021-01-28T04:01:22.588 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.071) 0:01:42.652 ****** 2021-01-28T04:01:22.623 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.035) 0:01:42.687 ****** 2021-01-28T04:01:22.642 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-28T04:01:22.643 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.645 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.655 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.657 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2021-01-28T04:01:22.657 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.708 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.084) 0:01:42.772 ****** 2021-01-28T04:01:22.714 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2021-01-28T04:01:22.717 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.759 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.051) 0:01:42.823 ****** 2021-01-28T04:01:22.768 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.770 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.772 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.772 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.834 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.074) 0:01:42.898 ****** 2021-01-28T04:01:22.844 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2021-01-28T04:01:22.846 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.848 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.860 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.914 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.079) 0:01:42.978 ****** 2021-01-28T04:01:22.921 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.923 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.924 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:22.967 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:22 +0000 (0:00:00.052) 0:01:43.031 ****** 2021-01-28T04:01:22.973 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2021-01-28T04:01:22.974 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.014 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.047) 0:01:43.079 ****** 2021-01-28T04:01:23.022 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.068 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.053) 0:01:43.133 ****** 2021-01-28T04:01:23.078 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2021-01-28T04:01:23.080 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.147 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.078) 0:01:43.211 ****** 2021-01-28T04:01:23.159 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.201 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.054) 0:01:43.265 ****** 2021-01-28T04:01:23.211 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2021-01-28T04:01:23.213 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.264 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.062) 0:01:43.328 ****** 2021-01-28T04:01:23.273 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.320 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.056) 0:01:43.384 ****** 2021-01-28T04:01:23.327 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2021-01-28T04:01:23.328 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.368 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.048) 0:01:43.432 ****** 2021-01-28T04:01:23.377 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.416 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.048) 0:01:43.480 ****** 2021-01-28T04:01:23.424 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2021-01-28T04:01:23.426 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.498 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.081) 0:01:43.562 ****** 2021-01-28T04:01:23.508 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.554 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.056) 0:01:43.618 ****** 2021-01-28T04:01:23.560 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-28T04:01:23.562 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.617 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.063) 0:01:43.681 ****** 2021-01-28T04:01:23.625 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.684 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.067) 0:01:43.748 ****** 2021-01-28T04:01:23.693 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2021-01-28T04:01:23.695 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.745 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.060) 0:01:43.809 ****** 2021-01-28T04:01:23.753 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.798 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.053) 0:01:43.862 ****** 2021-01-28T04:01:23.805 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2021-01-28T04:01:23.806 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.858 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.059) 0:01:43.922 ****** 2021-01-28T04:01:23.866 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:23.913 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:23 +0000 (0:00:00.055) 0:01:43.978 ****** 2021-01-28T04:01:24.100 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2021-01-28T04:01:24.102 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.011204", "end": "2021-01-28 04:01:23.746559", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-28 04:01:23.735355", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:24.143 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.010834", "end": "2021-01-28 04:01:24.479269", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2021-01-28 04:01:24.468435", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:24.279 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.019024", "end": "2021-01-28 04:01:23.927884", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-28 04:01:23.908860", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:24.344 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.023403", "end": "2021-01-28 04:01:24.675454", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2021-01-28 04:01:24.652051", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:24.440 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005362", "end": "2021-01-28 04:01:24.091429", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-28 04:01:24.086067", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:24.503 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005503", "end": "2021-01-28 04:01:24.851825", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2021-01-28 04:01:24.846322", "stderr": "find: '/etc/ceph': No such file or directory", "stderr_lines": ["find: '/etc/ceph': No such file or directory"], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:24.617 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.027051", "end": "2021-01-28 04:01:24.266409", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-28 04:01:24.239358", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:24.657 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:24 +0000 (0:00:00.743) 0:01:44.722 ****** 2021-01-28T04:01:24.685 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-28T04:01:24.687 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi150.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019893", "end": "2021-01-28 04:01:25.029136", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2021-01-28 04:01:25.009243", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:24.741 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:24 +0000 (0:00:00.083) 0:01:44.806 ****** 2021-01-28T04:01:24.782 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:24 +0000 (0:00:00.040) 0:01:44.846 ****** 2021-01-28T04:01:24.820 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2021-01-28T04:01:24.875 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:24 +0000 (0:00:00.093) 0:01:44.939 ****** 2021-01-28T04:01:24.920 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2021-01-28T04:01:24.922 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-28T04:01:25.065 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "size": 0, "state": "file", "uid": 0} 2021-01-28T04:01:25.187 INFO:teuthology.task.ansible.out: PLAY [testnodes,senta,vossi,jenkins_slaves] ************************************ 2021-01-28T04:01:25.236 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:25 +0000 (0:00:00.360) 0:01:45.300 ****** 2021-01-28T04:01:25.283 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:25 +0000 (0:00:00.047) 0:01:45.348 ****** 2021-01-28T04:01:26.270 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi134.front.sepia.ceph.com] 2021-01-28T04:01:26.348 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:26 +0000 (0:00:01.064) 0:01:46.412 ****** 2021-01-28T04:01:26.358 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] 2021-01-28T04:01:26.401 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T04:01:26.403 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-28T04:01:26.436 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:26 +0000 (0:00:00.088) 0:01:46.500 ****** 2021-01-28T04:01:26.472 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:26 +0000 (0:00:00.036) 0:01:46.536 ****** 2021-01-28T04:01:26.478 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T04:01:26.480 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:26.518 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:26 +0000 (0:00:00.045) 0:01:46.582 ****** 2021-01-28T04:01:26.526 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T04:01:26.528 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"package_manager": "apt"}, "changed": false} 2021-01-28T04:01:26.565 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:26 +0000 (0:00:00.046) 0:01:46.629 ****** 2021-01-28T04:01:26.572 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-28T04:01:26.574 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-28T04:01:26.613 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:26 +0000 (0:00:00.047) 0:01:46.677 ****** 2021-01-28T04:01:26.620 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T04:01:26.622 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:26.659 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:26 +0000 (0:00:00.046) 0:01:46.723 ****** 2021-01-28T04:01:26.697 INFO:teuthology.task.ansible.out: TASK [container-host : Including distro specific variables] ******************** 2021-01-28T04:01:26.699 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml) => {"ansible_facts": {"container_packages": ["docker.io"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/container-host/vars/apt_systems.yml"} 2021-01-28T04:01:26.742 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:26 +0000 (0:00:00.083) 0:01:46.806 ****** 2021-01-28T04:01:27.383 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-28T04:01:27.384 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"cache_update_time": 1611806183, "cache_updated": false, "changed": false} 2021-01-28T04:01:27.423 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:27 +0000 (0:00:00.680) 0:01:47.487 ****** 2021-01-28T04:01:27.451 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T04:01:27.453 INFO:teuthology.task.ansible.out:skipping: [smithi134.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:27.491 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:27 +0000 (0:00:00.068) 0:01:47.555 ****** 2021-01-28T04:01:27.509 INFO:teuthology.task.ansible.out: TASK [container-host : Install container packages] ***************************** 2021-01-28T04:01:27.511 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"cache_update_time": 1611806123, "cache_updated": false, "changed": false} 2021-01-28T04:01:27.548 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:27 +0000 (0:00:00.056) 0:01:47.612 ****** 2021-01-28T04:01:27.555 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T04:01:27.557 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-28T04:01:27.597 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:27 +0000 (0:00:00.049) 0:01:47.661 ****** 2021-01-28T04:01:27.603 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T04:01:27.605 INFO:teuthology.task.ansible.out:skipping: [smithi150.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2021-01-28T04:01:27.646 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:27 +0000 (0:00:00.048) 0:01:47.710 ****** 2021-01-28T04:01:27.684 INFO:teuthology.task.ansible.out: TASK [container-host : set_fact] *********************************************** 2021-01-28T04:01:27.686 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"ansible_facts": {"container_service_conf": "/etc/docker/daemon.json"}, "changed": false} 2021-01-28T04:01:27.722 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:27 +0000 (0:00:00.076) 0:01:47.786 ****** 2021-01-28T04:01:27.825 INFO:teuthology.task.ansible.out: TASK [container-host : Create container_mirror_cert_paths] ********************* 2021-01-28T04:01:27.827 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:01:27.953 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:01:27.975 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:01:28.021 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:28 +0000 (0:00:00.298) 0:01:48.085 ****** 2021-01-28T04:01:28.122 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "size": 4096, "state": "directory", "uid": 0} 2021-01-28T04:01:28.164 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:28 +0000 (0:00:00.142) 0:01:48.228 ****** 2021-01-28T04:01:28.523 INFO:teuthology.task.ansible.out: TASK [container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2021-01-28T04:01:28.525 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611806488.066146-174798276712370/source", "state": "file", "uid": 0} 2021-01-28T04:01:28.641 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/docker/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611806488.2065828-120527039883240/source", "state": "file", "uid": 0} 2021-01-28T04:01:28.940 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611806488.5318136-164400235121202/source", "state": "file", "uid": 0} 2021-01-28T04:01:28.989 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:28 +0000 (0:00:00.825) 0:01:49.054 ****** 2021-01-28T04:01:29.074 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => (item=/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000) => {"ansible_loop_var": "item", "changed": true, "checksum": "bcdfbb1de91ef82e0e4ed8af725c9ad52593eb79", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "item": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "md5sum": "a3fa0991425692932fcf703c1a9a483e", "mode": "0644", "owner": "root", "size": 2334, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611806488.6455884-253512937437376/source", "state": "file", "uid": 0} 2021-01-28T04:01:29.121 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:29 +0000 (0:00:00.130) 0:01:49.185 ****** 2021-01-28T04:01:33.764 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** 2021-01-28T04:01:33.766 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-u98r01vt\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-u98r01vt"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-u98r01vt\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=651188a15b3ce3c982f763f337f145c133651ddcf91c0fc63b32ca8a04b81615\n Stored in directory: /tmp/pip-ephem-wheel-cache-s5222i8i/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=45b7ee67f2fca54c4cc151464b6ef807d4330d98269901f1275621b0f70b84c6\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github. 2021-01-28T04:01:33.768 INFO:teuthology.task.ansible.out:com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-u98r01vt", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=651188a15b3ce3c982f763f337f145c133651ddcf91c0fc63b32ca8a04b81615", " Stored in directory: /tmp/pip-ephem-wheel-cache-s5222i8i/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=45b7ee67f2fca54c4cc151464b6ef807d4330d98269901f1275621b0f70b84c6", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-28T04:01:33.804 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:33 +0000 (0:00:04.683) 0:01:53.868 ****** 2021-01-28T04:01:34.000 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-01-28T04:01:34.002 INFO:teuthology.task.ansible.out:ok: [smithi134.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-28T04:01:34.051 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:34 +0000 (0:00:00.247) 0:01:54.115 ****** 2021-01-28T04:01:34.059 INFO:teuthology.task.ansible.out: TASK [container-host : Install registries-conf-ctl] **************************** changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["/usr/bin/pip3", "install", "-U", "git+https://github.com/sebastian-philipp/registries-conf-ctl"], "name": ["git+https://github.com/sebastian-philipp/registries-conf-ctl"], "requirements": null, "state": "latest", "stderr": " Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ceslxf3c\n", "stderr_lines": [" Running command git clone -q https://github.com/sebastian-philipp/registries-conf-ctl /tmp/pip-req-build-ceslxf3c"], "stdout": "Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl\n Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ceslxf3c\nCollecting docopt\n Downloading docopt-0.6.2.tar.gz (25 kB)\nCollecting toml\n Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)\nBuilding wheels for collected packages: registries-conf-ctl, docopt\n Building wheel for registries-conf-ctl (setup.py): started\n Building wheel for registries-conf-ctl (setup.py): finished with status 'done'\n Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=651188a15b3ce3c982f763f337f145c133651ddcf91c0fc63b32ca8a04b81615\n Stored in directory: /tmp/pip-ephem-wheel-cache-mwdqloo0/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42\n Building wheel for docopt (setup.py): started\n Building wheel for docopt (setup.py): finished with status 'done'\n Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=45b7ee67f2fca54c4cc151464b6ef807d4330d98269901f1275621b0f70b84c6\n Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c\nSuccessfully built registries-conf-ctl docopt\nInstalling collected packages: docopt, toml, registries-conf-ctl\nSuccessfully installed docopt-0.6.2 regi 2021-01-28T04:01:34.061 INFO:teuthology.task.ansible.out:stries-conf-ctl-1.0 toml-0.10.2\n", "stdout_lines": ["Collecting git+https://github.com/sebastian-philipp/registries-conf-ctl", " Cloning https://github.com/sebastian-philipp/registries-conf-ctl to ./pip-req-build-ceslxf3c", "Collecting docopt", " Downloading docopt-0.6.2.tar.gz (25 kB)", "Collecting toml", " Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB)", "Building wheels for collected packages: registries-conf-ctl, docopt", " Building wheel for registries-conf-ctl (setup.py): started", " Building wheel for registries-conf-ctl (setup.py): finished with status 'done'", " Created wheel for registries-conf-ctl: filename=registries_conf_ctl-1.0-py3-none-any.whl size=5333 sha256=651188a15b3ce3c982f763f337f145c133651ddcf91c0fc63b32ca8a04b81615", " Stored in directory: /tmp/pip-ephem-wheel-cache-mwdqloo0/wheels/66/49/be/0ca4a7322f6cd17532451655790e478b4f82776818b44d6d42", " Building wheel for docopt (setup.py): started", " Building wheel for docopt (setup.py): finished with status 'done'", " Created wheel for docopt: filename=docopt-0.6.2-py2.py3-none-any.whl size=13704 sha256=45b7ee67f2fca54c4cc151464b6ef807d4330d98269901f1275621b0f70b84c6", " Stored in directory: /root/.cache/pip/wheels/56/ea/58/ead137b087d9e326852a851351d1debf4ada529b6ac0ec4e8c", "Successfully built registries-conf-ctl docopt", "Installing collected packages: docopt, toml, registries-conf-ctl", "Successfully installed docopt-0.6.2 registries-conf-ctl-1.0 toml-0.10.2"], "version": null, "virtualenv": null} 2021-01-28T04:01:34.099 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:34 +0000 (0:00:00.047) 0:01:54.163 ****** 2021-01-28T04:01:34.297 INFO:teuthology.task.ansible.out: TASK [container-host : Check for docker's daemon.json] ************************* 2021-01-28T04:01:34.299 INFO:teuthology.task.ansible.out:ok: [smithi150.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2021-01-28T04:01:34.342 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:34 +0000 (0:00:00.243) 0:01:54.406 ****** 2021-01-28T04:01:34.520 INFO:teuthology.task.ansible.out: 2021-01-28T04:01:34.522 INFO:teuthology.task.ansible.out:TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611806494.085093-221568264249445/source", "state": "file", "uid": 0} 2021-01-28T04:01:34.571 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:34 +0000 (0:00:00.229) 0:01:54.635 ****** 2021-01-28T04:01:34.803 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-28T04:01:34.806 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.037775", "end": "2021-01-28 04:01:34.460321", "rc": 0, "start": "2021-01-28 04:01:34.422546", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:34.845 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:34 +0000 (0:00:00.274) 0:01:54.910 ****** 2021-01-28T04:01:34.853 INFO:teuthology.task.ansible.out: TASK [container-host : Create /etc/docker/daemon.json if necessary] ************ 2021-01-28T04:01:34.855 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "checksum": "bf21a9e8fbc5a3846fb05b4fa0859e0917b2202f", "dest": "/etc/docker/daemon.json", "gid": 0, "group": "root", "md5sum": "99914b932bd37a50b983c5e7c90ae93b", "mode": "0644", "owner": "root", "size": 2, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1611806494.4040647-263216569473919/source", "state": "file", "uid": 0} 2021-01-28T04:01:34.898 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:34 +0000 (0:00:00.052) 0:01:54.962 ****** 2021-01-28T04:01:35.142 INFO:teuthology.task.ansible.out: TASK [container-host : Add local docker.io registry mirror] ******************** 2021-01-28T04:01:35.144 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "cmd": ["registries-conf-ctl", "add-mirror", "docker.io", "docker-mirror.front.sepia.ceph.com:5000"], "delta": "0:00:00.037136", "end": "2021-01-28 04:01:35.488658", "rc": 0, "start": "2021-01-28 04:01:35.451522", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2021-01-28T04:01:35.191 INFO:teuthology.task.ansible.out:Thursday 28 January 2021 04:01:35 +0000 (0:00:00.292) 0:01:55.255 ****** 2021-01-28T04:01:38.285 INFO:teuthology.task.ansible.out: TASK [container-host : Restart docker service] ********************************* 2021-01-28T04:01:38.501 INFO:teuthology.task.ansible.out:changed: [smithi134.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "containerd.service network-online.target docker.socket sysinit.target system.slice firewalld.service basic.target systemd-journald.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-28T04:01:38.502 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-28T04:01:38.504 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-28T04:01:38.505 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "docker.socket system.slice sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 04:00:25 UTC", "StateChangeTimestampMonotonic": "91484531", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T04:01:38.844 INFO:teuthology.task.ansible.out:changed: [smithi150.front.sepia.ceph.com] => {"changed": true, "name": "docker", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target basic.target systemd-journald.socket network-online.target containerd.service firewalld.service docker.socket system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUAffinityFromNUMA": "no", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend cap_audit_read", "CleanResult": "success", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target", "ConsistsOf": "docker.socket", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "yes", "DelegateControllers": "cpu cpuacct cpuset io blkio memory devices pids bpf-fir 2021-01-28T04:01:38.846 INFO:teuthology.task.ansible.out:ewall bpf-devices", "Description": "Docker Application Container Engine", "DevicePolicy": "auto", "Documentation": "https://docs.docker.com", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecReloadEx": "{ path=/bin/kill ; argv[]=/bin/kill -s HUP $MAINPID ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartEx": "{ path=/usr/bin/dockerd ; argv[]=/usr/bin/dockerd -H fd:// --containerd=/run/containerd/containerd.sock ; flags= ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FinalKillSignal": "9", "FragmentPath": "/lib/systemd/system/docker.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOReadBytes": "18446744073709551615", "IOReadOperations": "18446744073709551615", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IOWriteBytes": "18446744073709551615", "IOWriteOperations": "18446744073709551615", "IPAccounting": "no", "IPEgressBytes": "[no data]", "IPEgressPackets": "[no data]", "IPIngressBytes": "[no data]", "IPIngressPackets": "[no data]", "Id": "docker.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "process", "KillSignal": "15", 2021-01-28T04:01:38.848 INFO:teuthology.task.ansible.out:"LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "infinity", "LimitNOFILESoft": "infinity", "LimitNPROC": "infinity", "LimitNPROCSoft": "infinity", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127781", "LimitSIGPENDINGSoft": "127781", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "docker.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "main", "OOMPolicy": "continue", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectHostname": "no", "ProtectKernelLogs": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "ReloadResult": "success", 2021-01-28T04:01:38.850 INFO:teuthology.task.ansible.out: "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice docker.socket sysinit.target", "Restart": "always", "RestartKillSignal": "15", "RestartUSec": "2s", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "3", "StartLimitIntervalUSec": "1min", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Thu 2021-01-28 04:00:26 UTC", "StateChangeTimestampMonotonic": "88678905", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "infinity", "TimeoutAbortUSec": "infinity", "TimeoutCleanUSec": "infinity", "TimeoutStartUSec": "infinity", "TimeoutStopUSec": "infinity", "TimerSlackNSec": "50000", "Transient": "no", "TriggeredBy": "docker.socket", "Type": "notify", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "containerd.service network-online.target", "WatchdogSignal": "6", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2021-01-28T04:01:38.949 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2021-01-28T04:01:38.953 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2021-01-28T04:01:38.957 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2021-01-28T04:01:38.958 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi134.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 smithi150.front.sepia.ceph.com : ok=121 changed=33 unreachable=0 failed=0 skipped=188 rescued=0 ignored=0 Thursday 28 January 2021 04:01:38 +0000 (0:00:03.766) 0:01:59.021 ****** =============================================================================== testnode : Ensure packages are not present. ---------------------------- 11.83s testnode : Install packages --------------------------------------------- 8.42s testnode : Zap all non-root disks --------------------------------------- 6.91s container-host : Install registries-conf-ctl ---------------------------- 4.68s container-host : Restart docker service --------------------------------- 3.77s common : Update apt cache ----------------------------------------------- 2.99s testnode : Install packages via pip ------------------------------------- 2.62s Gathering Facts --------------------------------------------------------- 2.42s testnode : Install apt keys --------------------------------------------- 2.18s testnode : Update apt cache. -------------------------------------------- 2.01s testnode : Install python-pip on apt based systems. --------------------- 1.19s testnode : Create logical volume(s) ------------------------------------- 1.14s Gathering Facts --------------------------------------------------------- 1.06s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 0.97s common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/. --- 0.95s Gathering Facts --------------------------------------------------------- 0.95s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.95s container-host : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert --- 0.83s users 2021-01-28T04:01:38.960 INFO:teuthology.task.ansible.out:: Create all admin users with sudo access. ------------------------ 0.82s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.74s 2021-01-28T04:01:39.292 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi150.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2021-01-28T04:01:39.293 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T04:01:39.295 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi150.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T04:01:39.342 DEBUG:teuthology.orchestra.run.smithi150:> true 2021-01-28T04:01:39.508 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2021-01-28T04:01:39.509 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2021-01-28T04:01:39.552 DEBUG:teuthology.orchestra.run.smithi134:> true 2021-01-28T04:01:39.723 INFO:teuthology.run_tasks:Running task clock... 2021-01-28T04:01:39.746 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2021-01-28T04:01:39.746 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-28T04:01:39.747 DEBUG:teuthology.orchestra.run.smithi150:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-28T04:01:39.780 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-28T04:01:39.780 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: Command line: ntpd -gq 2021-01-28T04:01:39.781 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: proto: precision = 0.304 usec (-22) 2021-01-28T04:01:39.782 INFO:teuthology.orchestra.run.smithi150.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-28T04:01:39.782 INFO:teuthology.orchestra.run.smithi150.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-28T04:01:39.783 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-28T04:01:39.783 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: restrict ::: KOD does nothing without LIMITED. 2021-01-28T04:01:39.783 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: Listen and drop on 0 v6wildcard [::]:123 2021-01-28T04:01:39.784 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-28T04:01:39.785 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: Listen normally on 2 lo 127.0.0.1:123 2021-01-28T04:01:39.785 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: Listen normally on 3 enp3s0f1 172.21.15.150:123 2021-01-28T04:01:39.785 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: Listen normally on 4 lo [::1]:123 2021-01-28T04:01:39.786 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6e35%5]:123 2021-01-28T04:01:39.786 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:40 ntpd[5452]: Listening on routing socket on fd #22 for interface updates 2021-01-28T04:01:40.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:41 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:40.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:41 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:40.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:41 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:40.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:41 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:40.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:41 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:40.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:41 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:41.781 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:42 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:41.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:42 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:41.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:42 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:41.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:42 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:41.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:42 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:41.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:42 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:42.781 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:42.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:42.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:42.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:42.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:42.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:42.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:42.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:42.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:42.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:42.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:42.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:43 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:43.781 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:43.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:43.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:43.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:43.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:43.787 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:43.787 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:43.787 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:44 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:44.781 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:44.781 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:44.781 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:44.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:44.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:44.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:44.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:44.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:44.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:44.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:44.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:44.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:45 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:45.781 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:45.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:45.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:45.782 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:45.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:45.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:45.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:45.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:45.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:45.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:45.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:45.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:46.783 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:47 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:46.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:47 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:46.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:47 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:46.784 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:47 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:46.785 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:47 ntpd[5452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:46.785 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:47 ntpd[5452]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:46.786 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:47 ntpd[5452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:46.786 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:47 ntpd[5452]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:46.787 INFO:teuthology.orchestra.run.smithi150.stderr:28 Jan 04:01:46 ntpd[5452]: can't open /var/log/ntpstats/loopstats.20210128: Permission denied 2021-01-28T04:01:46.788 INFO:teuthology.orchestra.run.smithi150.stdout:28 Jan 04:01:46 ntpd[5452]: ntpd: time set -0.374003 s 2021-01-28T04:01:46.789 INFO:teuthology.orchestra.run.smithi150.stdout:ntpd: time set -0.374003s 2021-01-28T04:01:46.877 INFO:teuthology.orchestra.run.smithi150.stdout: remote refid st t when poll reach delay offset jitter 2021-01-28T04:01:46.877 INFO:teuthology.orchestra.run.smithi150.stdout:============================================================================== 2021-01-28T04:01:46.878 INFO:teuthology.orchestra.run.smithi150.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T04:01:46.878 INFO:teuthology.orchestra.run.smithi150.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T04:01:46.878 INFO:teuthology.orchestra.run.smithi150.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T04:01:46.879 INFO:teuthology.orchestra.run.smithi150.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T04:01:46.880 INFO:teuthology.orchestra.run:Running command with timeout 360 2021-01-28T04:01:46.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2021-01-28T04:01:46.929 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: ntpd 4.2.8p12@1.3728-o (1): Starting 2021-01-28T04:01:46.929 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: Command line: ntpd -gq 2021-01-28T04:01:46.935 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: proto: precision = 0.283 usec (-22) 2021-01-28T04:01:46.936 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-28T04:01:46.936 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: restrict ::: KOD does nothing without LIMITED. 2021-01-28T04:01:46.936 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: Listen and drop on 0 v6wildcard [::]:123 2021-01-28T04:01:46.937 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2021-01-28T04:01:46.938 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: Listen normally on 2 lo 127.0.0.1:123 2021-01-28T04:01:46.938 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: Listen normally on 3 enp3s0f1 172.21.15.134:123 2021-01-28T04:01:46.938 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: Listen normally on 4 lo [::1]:123 2021-01-28T04:01:46.938 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6de9%5]:123 2021-01-28T04:01:46.939 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:46 ntpd[5442]: Listening on routing socket on fd #22 for interface updates 2021-01-28T04:01:46.939 INFO:teuthology.orchestra.run.smithi134.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2021-01-28T04:01:46.939 INFO:teuthology.orchestra.run.smithi134.stderr:restrict ::: KOD does nothing without LIMITED. 2021-01-28T04:01:47.929 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:47 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:47.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:47 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:47.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:47 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:47.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:47 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:47.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:47 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:47.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:47 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:49.932 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:49.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:49.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:49.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:49.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:49.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:49.935 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:49.935 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:49.936 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:49.936 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:49.936 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:49.937 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:49.937 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:49.938 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:49.938 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:49.938 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:49.939 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:49.939 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:49 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:50.929 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:50 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:50.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:50 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:50.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:50 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:50.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:50 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:50.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:50 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:50.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:50 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:51.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:51.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:51.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:51.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:51.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:51.932 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:51.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:51.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:51.935 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:51.936 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:51.937 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:51 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:52.929 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:52 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:52.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:52 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:52.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:52 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:52.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:52 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:52.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:52 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:52.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:52 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:53.930 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:53.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:53.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:53.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:53.931 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:53.932 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:53.932 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:53.932 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:53.932 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:53.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:53.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:53.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:53.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:53.933 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:53.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2021-01-28T04:01:53.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/rawstats.20210128: Permission denied 2021-01-28T04:01:53.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2021-01-28T04:01:53.934 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/peerstats.20210128: Permission denied 2021-01-28T04:01:53.935 INFO:teuthology.orchestra.run.smithi134.stderr:28 Jan 04:01:53 ntpd[5442]: can't open /var/log/ntpstats/loopstats.20210128: Permission denied 2021-01-28T04:01:53.935 INFO:teuthology.orchestra.run.smithi134.stdout:28 Jan 04:01:53 ntpd[5442]: ntpd: time set +0.316985 s 2021-01-28T04:01:53.935 INFO:teuthology.orchestra.run.smithi134.stdout:ntpd: time set +0.316985s 2021-01-28T04:01:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: remote refid st t when poll reach delay offset jitter 2021-01-28T04:01:53.994 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================== 2021-01-28T04:01:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T04:01:53.994 INFO:teuthology.orchestra.run.smithi134.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T04:01:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T04:01:53.995 INFO:teuthology.orchestra.run.smithi134.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2021-01-28T04:01:53.996 INFO:teuthology.run_tasks:Running task install... 2021-01-28T04:01:54.012 DEBUG:teuthology.task.install:project ceph 2021-01-28T04:01:54.014 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '507028cb839c25d6666833702df6325fd8569096'}} 2021-01-28T04:01:54.015 DEBUG:teuthology.task.install:config {'sha1': '507028cb839c25d6666833702df6325fd8569096'} 2021-01-28T04:01:54.015 INFO:teuthology.task.install:Using flavor: basic 2021-01-28T04:01:54.027 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2021-01-28T04:01:54.029 INFO:teuthology.task.install:extra packages: [] 2021-01-28T04:01:54.030 DEBUG:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2021-01-28T04:01:54.083 INFO:teuthology.orchestra.run.smithi150.stdout:Ubuntu 2021-01-28T04:01:54.089 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T04:01:54.090 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2021-01-28T04:01:54.091 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-key list | grep Ceph 2021-01-28T04:01:54.143 INFO:teuthology.orchestra.run.smithi134.stdout:Ubuntu 2021-01-28T04:01:54.148 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T04:01:54.149 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-key list | grep Ceph 2021-01-28T04:01:54.187 INFO:teuthology.orchestra.run.smithi150.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-28T04:01:54.246 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-28T04:01:54.246 INFO:teuthology.orchestra.run.smithi150.stdout:uid [ unknown] Ceph.com (release key) 2021-01-28T04:01:54.247 INFO:teuthology.orchestra.run.smithi134.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2021-01-28T04:01:54.248 DEBUG:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2021-01-28T04:01:54.297 INFO:teuthology.orchestra.run.smithi150.stdout:Ubuntu 2021-01-28T04:01:54.302 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T04:01:54.303 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-28T04:01:54.304 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:01:54.311 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2021-01-28T04:01:54.311 INFO:teuthology.orchestra.run.smithi134.stdout:uid [ unknown] Ceph.com (release key) 2021-01-28T04:01:54.311 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2021-01-28T04:01:54.361 INFO:teuthology.orchestra.run.smithi134.stdout:Ubuntu 2021-01-28T04:01:54.366 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T04:01:54.366 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2021-01-28T04:01:54.367 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:01:54.480 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default/ 2021-01-28T04:01:54.481 INFO:teuthology.task.install.deb:Package version is 17.0.0-184-g507028cb-1focal 2021-01-28T04:01:54.520 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default/ 2021-01-28T04:01:54.520 INFO:teuthology.task.install.deb:Package version is 17.0.0-184-g507028cb-1focal 2021-01-28T04:01:54.612 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:01:54.612 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-28T04:01:54.630 DEBUG:teuthology.orchestra.run.smithi150:> sudo apt-get update 2021-01-28T04:01:54.643 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:01:54.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2021-01-28T04:01:54.661 DEBUG:teuthology.orchestra.run.smithi134:> sudo apt-get update 2021-01-28T04:01:54.784 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-28T04:01:54.841 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal InRelease 2021-01-28T04:01:54.862 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2021-01-28T04:01:54.865 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-28T04:01:54.885 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T04:01:54.891 INFO:teuthology.orchestra.run.smithi150.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release.gpg 2021-01-28T04:01:54.915 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-28T04:01:54.917 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal InRelease 2021-01-28T04:01:54.942 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release [7,680 B] 2021-01-28T04:01:54.962 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-01-28T04:01:54.965 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-28T04:01:54.967 INFO:teuthology.orchestra.run.smithi134.stdout:Ign:4 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal Release.gpg 2021-01-28T04:01:54.968 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:5 http://archive.ubuntu.com/ubuntu focal InRelease 2021-01-28T04:01:54.991 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 Packages [16.6 kB] 2021-01-28T04:01:55.036 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main i386 Packages [3,097 B] 2021-01-28T04:01:55.045 INFO:teuthology.orchestra.run.smithi150.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-28T04:01:55.048 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2021-01-28T04:01:55.128 INFO:teuthology.orchestra.run.smithi134.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2021-01-28T04:01:55.450 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 27.3 kB in 1s (41.3 kB/s) 2021-01-28T04:01:55.520 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 27.3 kB in 1s (42.0 kB/s) 2021-01-28T04:01:56.169 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2021-01-28T04:01:56.189 DEBUG:teuthology.orchestra.run.smithi150:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-184-g507028cb-1focal cephadm=17.0.0-184-g507028cb-1focal ceph-mds=17.0.0-184-g507028cb-1focal ceph-mgr=17.0.0-184-g507028cb-1focal ceph-common=17.0.0-184-g507028cb-1focal ceph-fuse=17.0.0-184-g507028cb-1focal ceph-test=17.0.0-184-g507028cb-1focal radosgw=17.0.0-184-g507028cb-1focal python3-rados=17.0.0-184-g507028cb-1focal python3-rgw=17.0.0-184-g507028cb-1focal python3-cephfs=17.0.0-184-g507028cb-1focal python3-rbd=17.0.0-184-g507028cb-1focal libcephfs2=17.0.0-184-g507028cb-1focal libcephfs-dev=17.0.0-184-g507028cb-1focal librados2=17.0.0-184-g507028cb-1focal librbd1=17.0.0-184-g507028cb-1focal rbd-fuse=17.0.0-184-g507028cb-1focal 2021-01-28T04:01:56.256 INFO:teuthology.orchestra.run.smithi150.stdout:Reading package lists... 2021-01-28T04:01:56.269 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2021-01-28T04:01:56.290 DEBUG:teuthology.orchestra.run.smithi134:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.0.0-184-g507028cb-1focal cephadm=17.0.0-184-g507028cb-1focal ceph-mds=17.0.0-184-g507028cb-1focal ceph-mgr=17.0.0-184-g507028cb-1focal ceph-common=17.0.0-184-g507028cb-1focal ceph-fuse=17.0.0-184-g507028cb-1focal ceph-test=17.0.0-184-g507028cb-1focal radosgw=17.0.0-184-g507028cb-1focal python3-rados=17.0.0-184-g507028cb-1focal python3-rgw=17.0.0-184-g507028cb-1focal python3-cephfs=17.0.0-184-g507028cb-1focal python3-rbd=17.0.0-184-g507028cb-1focal libcephfs2=17.0.0-184-g507028cb-1focal libcephfs-dev=17.0.0-184-g507028cb-1focal librados2=17.0.0-184-g507028cb-1focal librbd1=17.0.0-184-g507028cb-1focal rbd-fuse=17.0.0-184-g507028cb-1focal 2021-01-28T04:01:56.361 INFO:teuthology.orchestra.run.smithi134.stdout:Reading package lists... 2021-01-28T04:01:56.407 INFO:teuthology.orchestra.run.smithi150.stdout:Building dependency tree... 2021-01-28T04:01:56.408 INFO:teuthology.orchestra.run.smithi150.stdout:Reading state information... 2021-01-28T04:01:56.512 INFO:teuthology.orchestra.run.smithi134.stdout:Building dependency tree... 2021-01-28T04:01:56.512 INFO:teuthology.orchestra.run.smithi134.stdout:Reading state information... 2021-01-28T04:01:56.538 INFO:teuthology.orchestra.run.smithi150.stdout:The following package was automatically installed and is no longer required: 2021-01-28T04:01:56.540 INFO:teuthology.orchestra.run.smithi150.stdout: libboost-iostreams1.71.0 2021-01-28T04:01:56.540 INFO:teuthology.orchestra.run.smithi150.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-28T04:01:56.540 INFO:teuthology.orchestra.run.smithi150.stdout:The following additional packages will be installed: 2021-01-28T04:01:56.541 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-28T04:01:56.541 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-28T04:01:56.541 INFO:teuthology.orchestra.run.smithi150.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-28T04:01:56.541 INFO:teuthology.orchestra.run.smithi150.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-28T04:01:56.542 INFO:teuthology.orchestra.run.smithi150.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-28T04:01:56.542 INFO:teuthology.orchestra.run.smithi150.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-28T04:01:56.542 INFO:teuthology.orchestra.run.smithi150.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-28T04:01:56.542 INFO:teuthology.orchestra.run.smithi150.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-28T04:01:56.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-28T04:01:56.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-28T04:01:56.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-28T04:01:56.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-28T04:01:56.543 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-28T04:01:56.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-28T04:01:56.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-28T04:01:56.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-28T04:01:56.544 INFO:teuthology.orchestra.run.smithi150.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-28T04:01:56.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-28T04:01:56.545 INFO:teuthology.orchestra.run.smithi150.stdout:Suggested packages: 2021-01-28T04:01:56.545 INFO:teuthology.orchestra.run.smithi150.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-28T04:01:56.546 INFO:teuthology.orchestra.run.smithi150.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-28T04:01:56.546 INFO:teuthology.orchestra.run.smithi150.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-28T04:01:56.546 INFO:teuthology.orchestra.run.smithi150.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-28T04:01:56.547 INFO:teuthology.orchestra.run.smithi150.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-28T04:01:56.547 INFO:teuthology.orchestra.run.smithi150.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-28T04:01:56.547 INFO:teuthology.orchestra.run.smithi150.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-28T04:01:56.547 INFO:teuthology.orchestra.run.smithi150.stdout:Recommended packages: 2021-01-28T04:01:56.547 INFO:teuthology.orchestra.run.smithi150.stdout: btrfs-tools 2021-01-28T04:01:56.630 INFO:teuthology.orchestra.run.smithi150.stdout:The following NEW packages will be installed: 2021-01-28T04:01:56.630 INFO:teuthology.orchestra.run.smithi150.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-28T04:01:56.630 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-28T04:01:56.631 INFO:teuthology.orchestra.run.smithi150.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-28T04:01:56.631 INFO:teuthology.orchestra.run.smithi150.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-28T04:01:56.631 INFO:teuthology.orchestra.run.smithi150.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-28T04:01:56.632 INFO:teuthology.orchestra.run.smithi150.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-28T04:01:56.632 INFO:teuthology.orchestra.run.smithi150.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-28T04:01:56.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-28T04:01:56.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-28T04:01:56.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-28T04:01:56.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-28T04:01:56.633 INFO:teuthology.orchestra.run.smithi150.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-28T04:01:56.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-28T04:01:56.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-28T04:01:56.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-28T04:01:56.634 INFO:teuthology.orchestra.run.smithi150.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-28T04:01:56.635 INFO:teuthology.orchestra.run.smithi150.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-28T04:01:56.635 INFO:teuthology.orchestra.run.smithi150.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-28T04:01:56.635 INFO:teuthology.orchestra.run.smithi150.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-28T04:01:56.635 INFO:teuthology.orchestra.run.smithi150.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-28T04:01:56.635 INFO:teuthology.orchestra.run.smithi150.stdout: rbd-fuse socat xmlstarlet 2021-01-28T04:01:56.636 INFO:teuthology.orchestra.run.smithi150.stdout:The following packages will be upgraded: 2021-01-28T04:01:56.636 INFO:teuthology.orchestra.run.smithi150.stdout: librados2 librbd1 2021-01-28T04:01:56.646 INFO:teuthology.orchestra.run.smithi134.stdout:The following package was automatically installed and is no longer required: 2021-01-28T04:01:56.647 INFO:teuthology.orchestra.run.smithi134.stdout: libboost-iostreams1.71.0 2021-01-28T04:01:56.648 INFO:teuthology.orchestra.run.smithi134.stdout:Use 'sudo apt autoremove' to remove it. 2021-01-28T04:01:56.648 INFO:teuthology.orchestra.run.smithi134.stdout:The following additional packages will be installed: 2021-01-28T04:01:56.648 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2021-01-28T04:01:56.648 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd jq 2021-01-28T04:01:56.648 INFO:teuthology.orchestra.run.smithi134.stdout: libjaeger libjq1 libjs-sphinxdoc libjs-underscore liblbfgsb0 libleveldb1d 2021-01-28T04:01:56.649 INFO:teuthology.orchestra.run.smithi134.stdout: liblttng-ust0 liboath0 libonig5 librabbitmq4 libradosstriper1 librdkafka1 2021-01-28T04:01:56.650 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 nvme-cli python-pastedeploy-tpl python3-atomicwrites python3-attr 2021-01-28T04:01:56.650 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt python3-bs4 python3-cachetools python3-ceph-argparse 2021-01-28T04:01:56.650 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common python3-cherrypy3 python3-decorator python3-google-auth 2021-01-28T04:01:56.651 INFO:teuthology.orchestra.run.smithi134.stdout: python3-html5lib python3-jinja2 python3-joblib python3-json-pointer 2021-01-28T04:01:56.651 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch python3-kubernetes python3-logutils python3-lxml 2021-01-28T04:01:56.651 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako python3-markupsafe python3-openssl python3-packaging 2021-01-28T04:01:56.652 INFO:teuthology.orchestra.run.smithi134.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2021-01-28T04:01:56.652 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-28T04:01:56.652 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2021-01-28T04:01:56.652 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2021-01-28T04:01:56.653 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric python3-singledispatch python3-sklearn 2021-01-28T04:01:56.653 INFO:teuthology.orchestra.run.smithi134.stdout: python3-sklearn-lib python3-soupsieve python3-tempita python3-waitress 2021-01-28T04:01:56.653 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth python3-webencodings python3-webob python3-websocket 2021-01-28T04:01:56.653 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest python3-werkzeug socat xmlstarlet 2021-01-28T04:01:56.653 INFO:teuthology.orchestra.run.smithi134.stdout:Suggested packages: 2021-01-28T04:01:56.654 INFO:teuthology.orchestra.run.smithi134.stdout: python3-influxdb python-attr-doc python3-genshi python-jinja2-doc 2021-01-28T04:01:56.654 INFO:teuthology.orchestra.run.smithi134.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2021-01-28T04:01:56.654 INFO:teuthology.orchestra.run.smithi134.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2021-01-28T04:01:56.654 INFO:teuthology.orchestra.run.smithi134.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2021-01-28T04:01:56.654 INFO:teuthology.orchestra.run.smithi134.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2021-01-28T04:01:56.655 INFO:teuthology.orchestra.run.smithi134.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2021-01-28T04:01:56.655 INFO:teuthology.orchestra.run.smithi134.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2021-01-28T04:01:56.655 INFO:teuthology.orchestra.run.smithi134.stdout:Recommended packages: 2021-01-28T04:01:56.655 INFO:teuthology.orchestra.run.smithi134.stdout: btrfs-tools 2021-01-28T04:01:56.740 INFO:teuthology.orchestra.run.smithi134.stdout:The following NEW packages will be installed: 2021-01-28T04:01:56.740 INFO:teuthology.orchestra.run.smithi134.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2021-01-28T04:01:56.740 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2021-01-28T04:01:56.741 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core ceph-mgr-rook ceph-mon ceph-osd ceph-test cephadm jq 2021-01-28T04:01:56.741 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-dev libcephfs2 libjaeger libjq1 libjs-sphinxdoc libjs-underscore 2021-01-28T04:01:56.741 INFO:teuthology.orchestra.run.smithi134.stdout: liblbfgsb0 libleveldb1d liblttng-ust0 liboath0 libonig5 librabbitmq4 2021-01-28T04:01:56.742 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 librdkafka1 librgw2 nvme-cli python-pastedeploy-tpl 2021-01-28T04:01:56.743 INFO:teuthology.orchestra.run.smithi134.stdout: python3-atomicwrites python3-attr python3-bcrypt python3-bs4 2021-01-28T04:01:56.743 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2021-01-28T04:01:56.743 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy3 python3-decorator python3-google-auth python3-html5lib 2021-01-28T04:01:56.743 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 python3-joblib python3-json-pointer python3-jsonpatch 2021-01-28T04:01:56.744 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes python3-logutils python3-lxml python3-mako 2021-01-28T04:01:56.744 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe python3-openssl python3-packaging python3-paste 2021-01-28T04:01:56.744 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pastedeploy python3-pastescript python3-pecan python3-pluggy 2021-01-28T04:01:56.744 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2021-01-28T04:01:56.744 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-rados 2021-01-28T04:01:56.745 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd python3-repoze.lru python3-requests-oauthlib python3-rgw 2021-01-28T04:01:56.745 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes python3-rsa python3-scipy python3-simplegeneric 2021-01-28T04:01:56.745 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2021-01-28T04:01:56.745 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2021-01-28T04:01:56.746 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug radosgw 2021-01-28T04:01:56.746 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse socat xmlstarlet 2021-01-28T04:01:56.746 INFO:teuthology.orchestra.run.smithi134.stdout:The following packages will be upgraded: 2021-01-28T04:01:56.747 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 librbd1 2021-01-28T04:01:56.814 INFO:teuthology.orchestra.run.smithi150.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-28T04:01:56.814 INFO:teuthology.orchestra.run.smithi150.stdout:Need to get 169 MB of archives. 2021-01-28T04:01:56.814 INFO:teuthology.orchestra.run.smithi150.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-28T04:01:56.815 INFO:teuthology.orchestra.run.smithi150.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-28T04:01:56.926 INFO:teuthology.orchestra.run.smithi134.stdout:2 upgraded, 94 newly installed, 0 to remove and 19 not upgraded. 2021-01-28T04:01:56.927 INFO:teuthology.orchestra.run.smithi134.stdout:Need to get 169 MB of archives. 2021-01-28T04:01:56.927 INFO:teuthology.orchestra.run.smithi134.stdout:After this operation, 781 MB of additional disk space will be used. 2021-01-28T04:01:56.927 INFO:teuthology.orchestra.run.smithi134.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2021-01-28T04:01:56.931 INFO:teuthology.orchestra.run.smithi150.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-184-g507028cb-1focal [3,716 B] 2021-01-28T04:01:57.043 INFO:teuthology.orchestra.run.smithi134.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libjaeger amd64 17.0.0-184-g507028cb-1focal [3,716 B] 2021-01-28T04:01:57.062 INFO:teuthology.orchestra.run.smithi150.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-184-g507028cb-1focal [3,291 kB] 2021-01-28T04:01:57.176 INFO:teuthology.orchestra.run.smithi134.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.0.0-184-g507028cb-1focal [3,291 kB] 2021-01-28T04:01:57.177 INFO:teuthology.orchestra.run.smithi150.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-28T04:01:57.184 INFO:teuthology.orchestra.run.smithi150.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-28T04:01:57.200 INFO:teuthology.orchestra.run.smithi150.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-28T04:01:57.308 INFO:teuthology.orchestra.run.smithi134.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2021-01-28T04:01:57.315 INFO:teuthology.orchestra.run.smithi134.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2021-01-28T04:01:57.317 INFO:teuthology.orchestra.run.smithi134.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2021-01-28T04:01:57.335 INFO:teuthology.orchestra.run.smithi150.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-28T04:01:57.370 INFO:teuthology.orchestra.run.smithi150.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-28T04:01:57.377 INFO:teuthology.orchestra.run.smithi150.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-28T04:01:57.385 INFO:teuthology.orchestra.run.smithi150.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-28T04:01:57.391 INFO:teuthology.orchestra.run.smithi150.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-28T04:01:57.414 INFO:teuthology.orchestra.run.smithi150.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-28T04:01:57.416 INFO:teuthology.orchestra.run.smithi150.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-28T04:01:57.417 INFO:teuthology.orchestra.run.smithi150.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-28T04:01:57.422 INFO:teuthology.orchestra.run.smithi150.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-28T04:01:57.422 INFO:teuthology.orchestra.run.smithi150.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-28T04:01:57.443 INFO:teuthology.orchestra.run.smithi134.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/main amd64 libleveldb1d amd64 1.22-3ubuntu2 [139 kB] 2021-01-28T04:01:57.485 INFO:teuthology.orchestra.run.smithi134.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2021-01-28T04:01:57.491 INFO:teuthology.orchestra.run.smithi134.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2021-01-28T04:01:57.495 INFO:teuthology.orchestra.run.smithi150.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-28T04:01:57.498 INFO:teuthology.orchestra.run.smithi134.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2021-01-28T04:01:57.500 INFO:teuthology.orchestra.run.smithi150.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-28T04:01:57.502 INFO:teuthology.orchestra.run.smithi150.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-28T04:01:57.502 INFO:teuthology.orchestra.run.smithi134.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2021-01-28T04:01:57.507 INFO:teuthology.orchestra.run.smithi150.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-28T04:01:57.511 INFO:teuthology.orchestra.run.smithi150.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-28T04:01:57.540 INFO:teuthology.orchestra.run.smithi134.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2021-01-28T04:01:57.543 INFO:teuthology.orchestra.run.smithi134.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2021-01-28T04:01:57.545 INFO:teuthology.orchestra.run.smithi134.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2 [59.1 kB] 2021-01-28T04:01:57.549 INFO:teuthology.orchestra.run.smithi134.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2021-01-28T04:01:57.550 INFO:teuthology.orchestra.run.smithi134.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2021-01-28T04:01:57.573 INFO:teuthology.orchestra.run.smithi150.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-28T04:01:57.598 INFO:teuthology.orchestra.run.smithi150.stdout:Get:23 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-184-g507028cb-1focal [3,345 kB] 2021-01-28T04:01:57.600 INFO:teuthology.orchestra.run.smithi150.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-28T04:01:57.601 INFO:teuthology.orchestra.run.smithi150.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-28T04:01:57.602 INFO:teuthology.orchestra.run.smithi150.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-28T04:01:57.603 INFO:teuthology.orchestra.run.smithi150.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-28T04:01:57.626 INFO:teuthology.orchestra.run.smithi134.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2021-01-28T04:01:57.630 INFO:teuthology.orchestra.run.smithi134.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2021-01-28T04:01:57.632 INFO:teuthology.orchestra.run.smithi134.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2021-01-28T04:01:57.637 INFO:teuthology.orchestra.run.smithi134.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-waitress all 1.4.1-1 [80.6 kB] 2021-01-28T04:01:57.642 INFO:teuthology.orchestra.run.smithi134.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2021-01-28T04:01:57.643 INFO:teuthology.orchestra.run.smithi134.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2021-01-28T04:01:57.652 INFO:teuthology.orchestra.run.smithi150.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-28T04:01:57.662 INFO:teuthology.orchestra.run.smithi150.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-28T04:01:57.668 INFO:teuthology.orchestra.run.smithi150.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-28T04:01:57.668 INFO:teuthology.orchestra.run.smithi150.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-28T04:01:57.670 INFO:teuthology.orchestra.run.smithi134.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2021-01-28T04:01:57.674 INFO:teuthology.orchestra.run.smithi150.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-28T04:01:57.705 INFO:teuthology.orchestra.run.smithi134.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2021-01-28T04:01:57.706 INFO:teuthology.orchestra.run.smithi134.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2021-01-28T04:01:57.708 INFO:teuthology.orchestra.run.smithi134.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2021-01-28T04:01:57.717 INFO:teuthology.orchestra.run.smithi134.stdout:Get:27 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.0.0-184-g507028cb-1focal [3,345 kB] 2021-01-28T04:01:57.731 INFO:teuthology.orchestra.run.smithi150.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-28T04:01:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-28T04:01:57.734 INFO:teuthology.orchestra.run.smithi150.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-28T04:01:57.736 INFO:teuthology.orchestra.run.smithi150.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-28T04:01:57.784 INFO:teuthology.orchestra.run.smithi134.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-werkzeug all 0.16.1+dfsg1-2 [183 kB] 2021-01-28T04:01:57.790 INFO:teuthology.orchestra.run.smithi134.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2021-01-28T04:01:57.793 INFO:teuthology.orchestra.run.smithi134.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2021-01-28T04:01:57.794 INFO:teuthology.orchestra.run.smithi134.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-underscore all 1.9.1~dfsg-1 [98.6 kB] 2021-01-28T04:01:57.796 INFO:teuthology.orchestra.run.smithi134.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2021-01-28T04:01:57.797 INFO:teuthology.orchestra.run.smithi134.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2021-01-28T04:01:57.798 INFO:teuthology.orchestra.run.smithi134.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2021-01-28T04:01:57.864 INFO:teuthology.orchestra.run.smithi134.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2021-01-28T04:01:57.865 INFO:teuthology.orchestra.run.smithi134.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2021-01-28T04:01:57.878 INFO:teuthology.orchestra.run.smithi150.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-184-g507028cb-1focal [705 kB] 2021-01-28T04:01:57.940 INFO:teuthology.orchestra.run.smithi150.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-184-g507028cb-1focal [409 kB] 2021-01-28T04:01:57.953 INFO:teuthology.orchestra.run.smithi150.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-184-g507028cb-1focal [21.7 kB] 2021-01-28T04:01:57.954 INFO:teuthology.orchestra.run.smithi150.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-184-g507028cb-1focal [197 kB] 2021-01-28T04:01:57.961 INFO:teuthology.orchestra.run.smithi150.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-184-g507028cb-1focal [29.4 kB] 2021-01-28T04:01:57.961 INFO:teuthology.orchestra.run.smithi150.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-184-g507028cb-1focal [385 kB] 2021-01-28T04:01:57.995 INFO:teuthology.orchestra.run.smithi134.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.0.0-184-g507028cb-1focal [705 kB] 2021-01-28T04:01:58.014 INFO:teuthology.orchestra.run.smithi150.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-184-g507028cb-1focal [3,501 kB] 2021-01-28T04:01:58.061 INFO:teuthology.orchestra.run.smithi134.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.0.0-184-g507028cb-1focal [409 kB] 2021-01-28T04:01:58.071 INFO:teuthology.orchestra.run.smithi134.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.0.0-184-g507028cb-1focal [21.7 kB] 2021-01-28T04:01:58.071 INFO:teuthology.orchestra.run.smithi134.stdout:Get:40 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.0.0-184-g507028cb-1focal [197 kB] 2021-01-28T04:01:58.074 INFO:teuthology.orchestra.run.smithi134.stdout:Get:41 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.0.0-184-g507028cb-1focal [29.4 kB] 2021-01-28T04:01:58.074 INFO:teuthology.orchestra.run.smithi134.stdout:Get:42 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.0.0-184-g507028cb-1focal [385 kB] 2021-01-28T04:01:58.076 INFO:teuthology.orchestra.run.smithi150.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-28T04:01:58.130 INFO:teuthology.orchestra.run.smithi150.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-28T04:01:58.131 INFO:teuthology.orchestra.run.smithi150.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-28T04:01:58.132 INFO:teuthology.orchestra.run.smithi134.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.0.0-184-g507028cb-1focal [3,501 kB] 2021-01-28T04:01:58.192 INFO:teuthology.orchestra.run.smithi134.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2021-01-28T04:01:58.198 INFO:teuthology.orchestra.run.smithi150.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-28T04:01:58.198 INFO:teuthology.orchestra.run.smithi150.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-28T04:01:58.199 INFO:teuthology.orchestra.run.smithi150.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-28T04:01:58.200 INFO:teuthology.orchestra.run.smithi150.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-28T04:01:58.200 INFO:teuthology.orchestra.run.smithi150.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-28T04:01:58.201 INFO:teuthology.orchestra.run.smithi150.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-28T04:01:58.201 INFO:teuthology.orchestra.run.smithi150.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-28T04:01:58.231 INFO:teuthology.orchestra.run.smithi134.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2021-01-28T04:01:58.232 INFO:teuthology.orchestra.run.smithi134.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2021-01-28T04:01:58.235 INFO:teuthology.orchestra.run.smithi150.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-28T04:01:58.239 INFO:teuthology.orchestra.run.smithi150.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-28T04:01:58.240 INFO:teuthology.orchestra.run.smithi150.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-184-g507028cb-1focal [116 kB] 2021-01-28T04:01:58.242 INFO:teuthology.orchestra.run.smithi150.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-184-g507028cb-1focal [446 kB] 2021-01-28T04:01:58.257 INFO:teuthology.orchestra.run.smithi150.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-184-g507028cb-1focal [22.0 MB] 2021-01-28T04:01:58.303 INFO:teuthology.orchestra.run.smithi134.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2021-01-28T04:01:58.303 INFO:teuthology.orchestra.run.smithi134.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2021-01-28T04:01:58.304 INFO:teuthology.orchestra.run.smithi134.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2021-01-28T04:01:58.305 INFO:teuthology.orchestra.run.smithi134.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2021-01-28T04:01:58.305 INFO:teuthology.orchestra.run.smithi134.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2021-01-28T04:01:58.306 INFO:teuthology.orchestra.run.smithi134.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2021-01-28T04:01:58.306 INFO:teuthology.orchestra.run.smithi134.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2021-01-28T04:01:58.313 INFO:teuthology.orchestra.run.smithi150.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-28T04:01:58.314 INFO:teuthology.orchestra.run.smithi150.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-28T04:01:58.317 INFO:teuthology.orchestra.run.smithi150.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-28T04:01:58.320 INFO:teuthology.orchestra.run.smithi150.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-28T04:01:58.322 INFO:teuthology.orchestra.run.smithi150.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-28T04:01:58.327 INFO:teuthology.orchestra.run.smithi150.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-28T04:01:58.330 INFO:teuthology.orchestra.run.smithi150.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-28T04:01:58.332 INFO:teuthology.orchestra.run.smithi150.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-28T04:01:58.353 INFO:teuthology.orchestra.run.smithi134.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2021-01-28T04:01:58.357 INFO:teuthology.orchestra.run.smithi134.stdout:Get:55 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.0.0-184-g507028cb-1focal [116 kB] 2021-01-28T04:01:58.358 INFO:teuthology.orchestra.run.smithi134.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-json-pointer all 2.0-0ubuntu1 [8,320 B] 2021-01-28T04:01:58.360 INFO:teuthology.orchestra.run.smithi134.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.0.0-184-g507028cb-1focal [446 kB] 2021-01-28T04:01:58.375 INFO:teuthology.orchestra.run.smithi134.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.0.0-184-g507028cb-1focal [22.0 MB] 2021-01-28T04:01:58.392 INFO:teuthology.orchestra.run.smithi150.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-28T04:01:58.393 INFO:teuthology.orchestra.run.smithi150.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-28T04:01:58.433 INFO:teuthology.orchestra.run.smithi134.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jsonpatch all 1.23-3 [12.0 kB] 2021-01-28T04:01:58.433 INFO:teuthology.orchestra.run.smithi134.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2021-01-28T04:01:58.436 INFO:teuthology.orchestra.run.smithi134.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2021-01-28T04:01:58.439 INFO:teuthology.orchestra.run.smithi134.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2021-01-28T04:01:58.441 INFO:teuthology.orchestra.run.smithi134.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2021-01-28T04:01:58.447 INFO:teuthology.orchestra.run.smithi134.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2021-01-28T04:01:58.450 INFO:teuthology.orchestra.run.smithi134.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2021-01-28T04:01:58.452 INFO:teuthology.orchestra.run.smithi134.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2021-01-28T04:01:58.470 INFO:teuthology.orchestra.run.smithi150.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-28T04:01:58.472 INFO:teuthology.orchestra.run.smithi150.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-28T04:01:58.492 INFO:teuthology.orchestra.run.smithi150.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-28T04:01:58.492 INFO:teuthology.orchestra.run.smithi150.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-28T04:01:58.493 INFO:teuthology.orchestra.run.smithi150.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-28T04:01:58.493 INFO:teuthology.orchestra.run.smithi150.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-28T04:01:58.494 INFO:teuthology.orchestra.run.smithi150.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-28T04:01:58.495 INFO:teuthology.orchestra.run.smithi150.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-28T04:01:58.514 INFO:teuthology.orchestra.run.smithi134.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2021-01-28T04:01:58.514 INFO:teuthology.orchestra.run.smithi134.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2021-01-28T04:01:58.549 INFO:teuthology.orchestra.run.smithi150.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-28T04:01:58.550 INFO:teuthology.orchestra.run.smithi150.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-28T04:01:58.592 INFO:teuthology.orchestra.run.smithi134.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2021-01-28T04:01:58.593 INFO:teuthology.orchestra.run.smithi134.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.2 [1,382 kB] 2021-01-28T04:01:58.613 INFO:teuthology.orchestra.run.smithi134.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2021-01-28T04:01:58.613 INFO:teuthology.orchestra.run.smithi134.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2021-01-28T04:01:58.614 INFO:teuthology.orchestra.run.smithi134.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2021-01-28T04:01:58.615 INFO:teuthology.orchestra.run.smithi134.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2021-01-28T04:01:58.615 INFO:teuthology.orchestra.run.smithi134.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-py all 1.8.1-1 [65.4 kB] 2021-01-28T04:01:58.616 INFO:teuthology.orchestra.run.smithi134.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2021-01-28T04:01:58.672 INFO:teuthology.orchestra.run.smithi134.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2021-01-28T04:01:58.672 INFO:teuthology.orchestra.run.smithi134.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2021-01-28T04:01:59.889 INFO:teuthology.orchestra.run.smithi150.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-184-g507028cb-1focal [5,866 kB] 2021-01-28T04:01:59.978 INFO:teuthology.orchestra.run.smithi134.stdout:Get:79 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.0.0-184-g507028cb-1focal [5,866 kB] 2021-01-28T04:02:00.212 INFO:teuthology.orchestra.run.smithi150.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-184-g507028cb-1focal [181 kB] 2021-01-28T04:02:00.214 INFO:teuthology.orchestra.run.smithi150.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-184-g507028cb-1focal [1,460 kB] 2021-01-28T04:02:00.294 INFO:teuthology.orchestra.run.smithi134.stdout:Get:80 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.0.0-184-g507028cb-1focal [181 kB] 2021-01-28T04:02:00.305 INFO:teuthology.orchestra.run.smithi134.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.0.0-184-g507028cb-1focal [1,460 kB] 2021-01-28T04:02:00.335 INFO:teuthology.orchestra.run.smithi150.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-184-g507028cb-1focal [6,916 kB] 2021-01-28T04:02:00.393 INFO:teuthology.orchestra.run.smithi134.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.0.0-184-g507028cb-1focal [6,916 kB] 2021-01-28T04:02:00.781 INFO:teuthology.orchestra.run.smithi150.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-184-g507028cb-1focal [25.9 MB] 2021-01-28T04:02:00.849 INFO:teuthology.orchestra.run.smithi134.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.0.0-184-g507028cb-1focal [25.9 MB] 2021-01-28T04:02:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-184-g507028cb-1focal [3,804 B] 2021-01-28T04:02:02.605 INFO:teuthology.orchestra.run.smithi134.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-184-g507028cb-1focal [808 kB] 2021-01-28T04:02:02.618 INFO:teuthology.orchestra.run.smithi134.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-184-g507028cb-1focal [2,304 kB] 2021-01-28T04:02:02.621 INFO:teuthology.orchestra.run.smithi150.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.0.0-184-g507028cb-1focal [3,804 B] 2021-01-28T04:02:02.622 INFO:teuthology.orchestra.run.smithi150.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.0.0-184-g507028cb-1focal [808 kB] 2021-01-28T04:02:02.635 INFO:teuthology.orchestra.run.smithi150.stdout:Get:86 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.0.0-184-g507028cb-1focal [2,304 kB] 2021-01-28T04:02:02.747 INFO:teuthology.orchestra.run.smithi134.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-184-g507028cb-1focal [61.6 kB] 2021-01-28T04:02:02.748 INFO:teuthology.orchestra.run.smithi134.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-184-g507028cb-1focal [63.9 kB] 2021-01-28T04:02:02.759 INFO:teuthology.orchestra.run.smithi150.stdout:Get:87 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.0.0-184-g507028cb-1focal [61.6 kB] 2021-01-28T04:02:02.760 INFO:teuthology.orchestra.run.smithi134.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-184-g507028cb-1focal [2,327 kB] 2021-01-28T04:02:02.763 INFO:teuthology.orchestra.run.smithi150.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.0.0-184-g507028cb-1focal [63.9 kB] 2021-01-28T04:02:02.765 INFO:teuthology.orchestra.run.smithi150.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.0.0-184-g507028cb-1focal [2,327 kB] 2021-01-28T04:02:02.907 INFO:teuthology.orchestra.run.smithi150.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-184-g507028cb-1focal [7,896 kB] 2021-01-28T04:02:02.925 INFO:teuthology.orchestra.run.smithi134.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.0.0-184-g507028cb-1focal [7,896 kB] 2021-01-28T04:02:03.430 INFO:teuthology.orchestra.run.smithi150.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-184-g507028cb-1focal [3,920 B] 2021-01-28T04:02:03.430 INFO:teuthology.orchestra.run.smithi150.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-184-g507028cb-1focal [22.6 kB] 2021-01-28T04:02:03.431 INFO:teuthology.orchestra.run.smithi150.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-184-g507028cb-1focal [48.1 MB] 2021-01-28T04:02:03.448 INFO:teuthology.orchestra.run.smithi134.stdout:Get:91 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.0.0-184-g507028cb-1focal [3,920 B] 2021-01-28T04:02:03.448 INFO:teuthology.orchestra.run.smithi134.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-rook all 17.0.0-184-g507028cb-1focal [22.6 kB] 2021-01-28T04:02:03.498 INFO:teuthology.orchestra.run.smithi134.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.0.0-184-g507028cb-1focal [48.1 MB] 2021-01-28T04:02:06.826 INFO:teuthology.orchestra.run.smithi150.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-184-g507028cb-1focal [19.8 kB] 2021-01-28T04:02:06.827 INFO:teuthology.orchestra.run.smithi150.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-184-g507028cb-1focal [10.7 MB] 2021-01-28T04:02:06.836 INFO:teuthology.orchestra.run.smithi134.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.0.0-184-g507028cb-1focal [19.8 kB] 2021-01-28T04:02:06.836 INFO:teuthology.orchestra.run.smithi134.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.0.0-184-g507028cb-1focal [10.7 MB] 2021-01-28T04:02:07.388 INFO:teuthology.orchestra.run.smithi134.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-184-g507028cb-1focal [77.7 kB] 2021-01-28T04:02:07.395 INFO:teuthology.orchestra.run.smithi150.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-kefu-testing-2021-01-27-1353/507028cb839c25d6666833702df6325fd8569096/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.0.0-184-g507028cb-1focal [77.7 kB] 2021-01-28T04:02:07.989 INFO:teuthology.orchestra.run.smithi150.stdout:Fetched 169 MB in 11s (15.7 MB/s) 2021-01-28T04:02:07.990 INFO:teuthology.orchestra.run.smithi134.stdout:Fetched 169 MB in 11s (15.9 MB/s) 2021-01-28T04:02:08.058 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjaeger. 2021-01-28T04:02:08.110 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjaeger. 2021-01-28T04:02:08.119 INFO:teuthology.orchestra.run.smithi134.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-28T04:02:08.122 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../00-libjaeger_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:08.164 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:08.171 INFO:teuthology.orchestra.run.smithi150.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 150606 files and directories currently installed.) 2021-01-28T04:02:08.176 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../00-libjaeger_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:08.216 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:08.468 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-28T04:02:08.484 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-28T04:02:08.560 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2021-01-28T04:02:08.577 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../01-liblttng-ust0_2.11.0-1_amd64.deb ... 2021-01-28T04:02:08.654 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-28T04:02:08.677 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-28T04:02:09.048 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../02-librbd1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:09.083 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../02-librbd1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:09.196 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librbd1 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-28T04:02:09.214 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librbd1 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-28T04:02:09.833 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../03-librados2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:09.910 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../03-librados2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:09.983 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librados2 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-28T04:02:10.019 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librados2 (17.0.0-184-g507028cb-1focal) over (15.2.7-0ubuntu0.20.04.2) ... 2021-01-28T04:02:10.645 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs2. 2021-01-28T04:02:10.664 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:10.703 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:10.723 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs2. 2021-01-28T04:02:10.741 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../04-libcephfs2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:10.782 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:11.006 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rados. 2021-01-28T04:02:11.024 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../05-python3-rados_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:11.055 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:11.118 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rados. 2021-01-28T04:02:11.136 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../05-python3-rados_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:11.184 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:11.425 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-28T04:02:11.443 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:11.483 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:11.545 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-argparse. 2021-01-28T04:02:11.564 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../06-python3-ceph-argparse_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:11.628 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:11.736 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cephfs. 2021-01-28T04:02:11.753 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:11.794 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:11.889 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cephfs. 2021-01-28T04:02:11.908 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../07-python3-cephfs_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:11.947 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:12.163 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-28T04:02:12.180 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:12.221 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:12.307 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-ceph-common. 2021-01-28T04:02:12.317 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../08-python3-ceph-common_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:12.384 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:12.499 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-prettytable. 2021-01-28T04:02:12.519 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-28T04:02:12.549 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-28T04:02:12.678 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-prettytable. 2021-01-28T04:02:12.698 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../09-python3-prettytable_0.7.2-5_all.deb ... 2021-01-28T04:02:12.736 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2021-01-28T04:02:12.827 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rbd. 2021-01-28T04:02:12.844 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:12.885 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:12.964 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rbd. 2021-01-28T04:02:12.981 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../10-python3-rbd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:13.022 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:13.263 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-28T04:02:13.280 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-28T04:02:13.321 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-28T04:02:13.459 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librabbitmq4:amd64. 2021-01-28T04:02:13.476 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../11-librabbitmq4_0.10.0-1_amd64.deb ... 2021-01-28T04:02:13.517 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2021-01-28T04:02:13.674 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-28T04:02:13.694 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-28T04:02:13.735 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-28T04:02:13.903 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librdkafka1:amd64. 2021-01-28T04:02:13.919 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../12-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2021-01-28T04:02:13.986 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-28T04:02:14.085 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package librgw2. 2021-01-28T04:02:14.103 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../13-librgw2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:14.159 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:14.331 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package librgw2. 2021-01-28T04:02:14.351 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../13-librgw2_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:14.406 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:14.729 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rgw. 2021-01-28T04:02:14.748 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:14.787 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:15.000 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rgw. 2021-01-28T04:02:15.016 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../14-python3-rgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:15.058 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:15.098 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-28T04:02:15.118 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-28T04:02:15.156 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-28T04:02:15.420 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libleveldb1d:amd64. 2021-01-28T04:02:15.437 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../15-libleveldb1d_1.22-3ubuntu2_amd64.deb ... 2021-01-28T04:02:15.478 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-28T04:02:15.500 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liboath0. 2021-01-28T04:02:15.517 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-28T04:02:15.583 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-28T04:02:15.847 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liboath0. 2021-01-28T04:02:15.865 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../16-liboath0_2.6.1-1.3_amd64.deb ... 2021-01-28T04:02:15.886 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libradosstriper1. 2021-01-28T04:02:15.906 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:15.922 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2021-01-28T04:02:15.944 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:16.266 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libradosstriper1. 2021-01-28T04:02:16.284 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../17-libradosstriper1_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:16.325 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:16.331 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-common. 2021-01-28T04:02:16.348 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../18-ceph-common_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:16.389 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:16.770 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-common. 2021-01-28T04:02:16.787 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../18-ceph-common_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:16.820 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:18.661 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-base. 2021-01-28T04:02:18.677 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../19-ceph-base_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:18.721 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:19.118 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-base. 2021-01-28T04:02:19.136 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../19-ceph-base_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:19.186 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:19.690 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-openssl. 2021-01-28T04:02:19.708 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-28T04:02:19.748 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-28T04:02:20.034 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-28T04:02:20.051 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:20.092 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:20.235 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-openssl. 2021-01-28T04:02:20.255 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../20-python3-openssl_19.0.0-1build1_all.deb ... 2021-01-28T04:02:20.296 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2021-01-28T04:02:20.448 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-28T04:02:20.466 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-28T04:02:20.530 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-28T04:02:20.574 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2021-01-28T04:02:20.592 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../21-ceph-mgr-modules-core_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:20.632 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:20.833 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-28T04:02:20.849 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-28T04:02:20.891 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-28T04:02:21.046 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bcrypt. 2021-01-28T04:02:21.062 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../22-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2021-01-28T04:02:21.106 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-28T04:02:21.270 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-logutils. 2021-01-28T04:02:21.288 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-28T04:02:21.327 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-28T04:02:21.432 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cherrypy3. 2021-01-28T04:02:21.449 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../23-python3-cherrypy3_8.9.1-6_all.deb ... 2021-01-28T04:02:21.523 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2021-01-28T04:02:21.614 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-28T04:02:21.634 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-28T04:02:21.672 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-28T04:02:21.887 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-logutils. 2021-01-28T04:02:21.904 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../24-python3-logutils_0.3.3-7_all.deb ... 2021-01-28T04:02:21.945 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-logutils (0.3.3-7) ... 2021-01-28T04:02:21.999 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-mako. 2021-01-28T04:02:22.019 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-28T04:02:22.057 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-28T04:02:22.307 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-markupsafe. 2021-01-28T04:02:22.324 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../25-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2021-01-28T04:02:22.365 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2021-01-28T04:02:22.379 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-28T04:02:22.397 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-28T04:02:22.429 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-28T04:02:22.716 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-28T04:02:22.726 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-mako. 2021-01-28T04:02:22.732 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-28T04:02:22.743 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../26-python3-mako_1.1.0+ds1-1ubuntu2_all.deb ... 2021-01-28T04:02:22.773 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-28T04:02:22.792 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-28T04:02:23.076 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webob. 2021-01-28T04:02:23.093 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-28T04:02:23.134 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-28T04:02:23.163 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-simplegeneric. 2021-01-28T04:02:23.180 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../27-python3-simplegeneric_0.8.1-3_all.deb ... 2021-01-28T04:02:23.220 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2021-01-28T04:02:23.470 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-28T04:02:23.487 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-28T04:02:23.528 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-28T04:02:23.565 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-singledispatch. 2021-01-28T04:02:23.582 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../28-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2021-01-28T04:02:23.623 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2021-01-28T04:02:23.831 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-bs4. 2021-01-28T04:02:23.848 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-28T04:02:23.889 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-28T04:02:23.951 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webob. 2021-01-28T04:02:23.971 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../29-python3-webob_1%3a1.8.5-2_all.deb ... 2021-01-28T04:02:24.031 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2021-01-28T04:02:24.234 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-waitress. 2021-01-28T04:02:24.251 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-28T04:02:24.295 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-28T04:02:24.371 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-soupsieve. 2021-01-28T04:02:24.388 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../30-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2021-01-28T04:02:24.429 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-28T04:02:24.628 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-tempita. 2021-01-28T04:02:24.645 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-28T04:02:24.714 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-28T04:02:24.757 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-bs4. 2021-01-28T04:02:24.776 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../31-python3-bs4_4.8.2-1_all.deb ... 2021-01-28T04:02:24.831 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2021-01-28T04:02:24.998 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-paste. 2021-01-28T04:02:25.015 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-28T04:02:25.056 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-28T04:02:25.226 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-waitress. 2021-01-28T04:02:25.247 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../32-python3-waitress_1.4.1-1_all.deb ... 2021-01-28T04:02:25.321 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-waitress (1.4.1-1) ... 2021-01-28T04:02:25.367 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-28T04:02:25.387 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-28T04:02:25.442 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-28T04:02:25.688 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-tempita. 2021-01-28T04:02:25.705 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../33-python3-tempita_0.5.2-6_all.deb ... 2021-01-28T04:02:25.753 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-28T04:02:25.754 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-tempita (0.5.2-6) ... 2021-01-28T04:02:25.770 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-28T04:02:25.811 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-28T04:02:26.107 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-paste. 2021-01-28T04:02:26.127 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../34-python3-paste_3.4.0+dfsg1-1_all.deb ... 2021-01-28T04:02:26.139 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webtest. 2021-01-28T04:02:26.157 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-28T04:02:26.165 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2021-01-28T04:02:26.197 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-28T04:02:26.500 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pecan. 2021-01-28T04:02:26.510 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2021-01-28T04:02:26.519 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-28T04:02:26.528 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../35-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2021-01-28T04:02:26.558 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-28T04:02:26.593 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2021-01-28T04:02:26.922 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-28T04:02:26.938 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastedeploy. 2021-01-28T04:02:26.939 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-28T04:02:26.956 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../36-python3-pastedeploy_2.1.0-1_all.deb ... 2021-01-28T04:02:26.980 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-28T04:02:26.996 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2021-01-28T04:02:27.350 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr. 2021-01-28T04:02:27.357 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webtest. 2021-01-28T04:02:27.367 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:27.378 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../37-python3-webtest_2.0.32-2_all.deb ... 2021-01-28T04:02:27.408 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:27.415 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webtest (2.0.32-2) ... 2021-01-28T04:02:27.752 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pecan. 2021-01-28T04:02:27.769 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../38-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2021-01-28T04:02:27.810 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2021-01-28T04:02:27.903 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mon. 2021-01-28T04:02:27.921 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:27.961 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:28.206 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-werkzeug. 2021-01-28T04:02:28.224 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../39-python3-werkzeug_0.16.1+dfsg1-2_all.deb ... 2021-01-28T04:02:28.264 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-28T04:02:28.668 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr. 2021-01-28T04:02:28.687 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../40-ceph-mgr_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:28.726 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:29.039 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-osd. 2021-01-28T04:02:29.056 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:29.097 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:29.238 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mon. 2021-01-28T04:02:29.258 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../41-ceph-mon_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:29.296 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:30.741 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-osd. 2021-01-28T04:02:30.760 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../42-ceph-osd_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:30.818 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:31.828 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph. 2021-01-28T04:02:31.846 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../43-ceph_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:31.885 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:32.230 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-fuse. 2021-01-28T04:02:32.247 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:32.288 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:32.750 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mds. 2021-01-28T04:02:32.767 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:32.808 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:33.286 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package cephadm. 2021-01-28T04:02:33.305 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../46-cephadm_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:33.343 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:33.371 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph. 2021-01-28T04:02:33.389 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../43-ceph_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:33.454 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:33.663 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jinja2. 2021-01-28T04:02:33.680 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-28T04:02:33.721 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-28T04:02:33.807 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-fuse. 2021-01-28T04:02:33.824 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../44-ceph-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:33.865 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:34.066 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-28T04:02:34.083 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:34.124 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:34.318 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mds. 2021-01-28T04:02:34.336 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../45-ceph-mds_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:34.376 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:34.444 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-28T04:02:34.460 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-28T04:02:34.503 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-28T04:02:34.780 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjs-underscore. 2021-01-28T04:02:34.799 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-28T04:02:34.838 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-28T04:02:34.972 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package cephadm. 2021-01-28T04:02:34.988 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../46-cephadm_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:35.030 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:35.374 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jinja2. 2021-01-28T04:02:35.391 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../47-python3-jinja2_2.10.1-2_all.deb ... 2021-01-28T04:02:35.466 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-28T04:02:35.486 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-28T04:02:35.524 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-28T04:02:35.532 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2021-01-28T04:02:35.860 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-routes. 2021-01-28T04:02:35.878 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-28T04:02:35.926 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-28T04:02:36.077 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2021-01-28T04:02:36.098 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../48-ceph-mgr-cephadm_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:36.135 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:36.296 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-28T04:02:36.315 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:36.354 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:36.530 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-repoze.lru. 2021-01-28T04:02:36.548 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../49-python3-repoze.lru_0.7-2_all.deb ... 2021-01-28T04:02:36.588 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2021-01-28T04:02:36.866 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjs-underscore. 2021-01-28T04:02:36.883 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../50-libjs-underscore_1.9.1~dfsg-1_all.deb ... 2021-01-28T04:02:36.924 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1) ... 2021-01-28T04:02:37.227 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjs-sphinxdoc. 2021-01-28T04:02:37.244 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../51-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2021-01-28T04:02:37.261 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-decorator. 2021-01-28T04:02:37.279 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-28T04:02:37.294 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-28T04:02:37.319 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-28T04:02:37.680 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-routes. 2021-01-28T04:02:37.680 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-28T04:02:37.697 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-28T04:02:37.698 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../52-python3-routes_2.4.1-2_all.deb ... 2021-01-28T04:02:37.738 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-routes (2.4.1-2) ... 2021-01-28T04:02:37.747 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-28T04:02:38.058 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-scipy. 2021-01-28T04:02:38.076 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-28T04:02:38.116 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-28T04:02:38.133 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2021-01-28T04:02:38.150 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../53-ceph-mgr-dashboard_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:38.191 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:39.107 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-decorator. 2021-01-28T04:02:39.127 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../54-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2021-01-28T04:02:39.182 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2021-01-28T04:02:39.452 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-28T04:02:39.468 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2021-01-28T04:02:39.469 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-28T04:02:39.487 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../55-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2021-01-28T04:02:39.518 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-28T04:02:39.518 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-28T04:02:39.846 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-scipy. 2021-01-28T04:02:39.864 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../56-python3-scipy_1.3.3-3build1_amd64.deb ... 2021-01-28T04:02:39.929 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2021-01-28T04:02:40.088 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-joblib. 2021-01-28T04:02:40.105 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-28T04:02:40.146 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-28T04:02:40.592 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-sklearn. 2021-01-28T04:02:40.611 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-28T04:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-28T04:02:41.331 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn-lib. 2021-01-28T04:02:41.333 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-28T04:02:41.349 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../57-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2021-01-28T04:02:41.354 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:41.381 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-28T04:02:41.391 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:41.976 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-joblib. 2021-01-28T04:02:41.995 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../58-python3-joblib_0.14.0-3_all.deb ... 2021-01-28T04:02:42.035 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-joblib (0.14.0-3) ... 2021-01-28T04:02:42.480 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-sklearn. 2021-01-28T04:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-cachetools. 2021-01-28T04:02:42.496 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../59-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2021-01-28T04:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-28T04:02:42.538 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-28T04:02:42.560 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-28T04:02:42.905 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-28T04:02:42.923 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-28T04:02:42.963 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-28T04:02:43.316 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-28T04:02:43.321 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2021-01-28T04:02:43.338 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-28T04:02:43.339 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../60-ceph-mgr-diskprediction-local_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:43.374 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-28T04:02:43.396 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:43.669 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-rsa. 2021-01-28T04:02:43.690 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-28T04:02:43.727 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-28T04:02:44.056 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-google-auth. 2021-01-28T04:02:44.073 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-28T04:02:44.113 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-28T04:02:44.442 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-28T04:02:44.460 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-28T04:02:44.500 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-28T04:02:44.574 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-cachetools. 2021-01-28T04:02:44.591 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../61-python3-cachetools_4.0.0-1_all.deb ... 2021-01-28T04:02:44.632 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2021-01-28T04:02:44.861 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-websocket. 2021-01-28T04:02:44.882 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-28T04:02:44.919 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-28T04:02:45.027 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1. 2021-01-28T04:02:45.047 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../62-python3-pyasn1_0.4.2-3build1_all.deb ... 2021-01-28T04:02:45.085 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2021-01-28T04:02:45.231 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-28T04:02:45.248 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-28T04:02:45.322 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-28T04:02:45.439 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyasn1-modules. 2021-01-28T04:02:45.456 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../63-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2021-01-28T04:02:45.521 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-28T04:02:45.858 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-rsa. 2021-01-28T04:02:45.868 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-28T04:02:45.876 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../64-python3-rsa_4.0-3_all.deb ... 2021-01-28T04:02:45.887 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:45.916 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-rsa (4.0-3) ... 2021-01-28T04:02:45.926 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:46.254 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-28T04:02:46.275 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-28T04:02:46.303 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-google-auth. 2021-01-28T04:02:46.312 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-28T04:02:46.320 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../65-python3-google-auth_1.5.1-2_all.deb ... 2021-01-28T04:02:46.369 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2021-01-28T04:02:46.640 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-28T04:02:46.661 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-28T04:02:46.723 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-28T04:02:46.766 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-requests-oauthlib. 2021-01-28T04:02:46.786 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../66-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2021-01-28T04:02:46.831 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-28T04:02:47.035 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-28T04:02:47.052 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:47.093 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:47.175 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-websocket. 2021-01-28T04:02:47.192 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../67-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2021-01-28T04:02:47.233 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2021-01-28T04:02:47.446 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-28T04:02:47.464 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-28T04:02:47.504 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-28T04:02:47.595 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-kubernetes. 2021-01-28T04:02:47.612 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../68-python3-kubernetes_7.0.0~a1-2_all.deb ... 2021-01-28T04:02:47.653 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2021-01-28T04:02:47.857 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-28T04:02:47.875 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-28T04:02:47.915 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-28T04:02:48.193 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package jq. 2021-01-28T04:02:48.211 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-28T04:02:48.224 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2021-01-28T04:02:48.242 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-28T04:02:48.244 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../69-ceph-mgr-k8sevents_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:48.308 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:48.478 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package socat. 2021-01-28T04:02:48.498 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-28T04:02:48.536 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-28T04:02:48.660 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-json-pointer. 2021-01-28T04:02:48.678 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../70-python3-json-pointer_2.0-0ubuntu1_all.deb ... 2021-01-28T04:02:48.727 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-json-pointer (2.0-0ubuntu1) ... 2021-01-28T04:02:48.890 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package xmlstarlet. 2021-01-28T04:02:48.907 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-28T04:02:48.948 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-28T04:02:49.113 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-jsonpatch. 2021-01-28T04:02:49.135 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../71-python3-jsonpatch_1.23-3_all.deb ... 2021-01-28T04:02:49.171 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-jsonpatch (1.23-3) ... 2021-01-28T04:02:49.285 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package ceph-test. 2021-01-28T04:02:49.306 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../78-ceph-test_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:49.343 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:49.500 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-mgr-rook. 2021-01-28T04:02:49.519 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../72-ceph-mgr-rook_17.0.0-184-g507028cb-1focal_all.deb ... 2021-01-28T04:02:49.574 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:49.919 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libonig5:amd64. 2021-01-28T04:02:49.937 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../73-libonig5_6.9.4-1_amd64.deb ... 2021-01-28T04:02:49.977 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2021-01-28T04:02:50.422 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libjq1:amd64. 2021-01-28T04:02:50.479 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../74-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-28T04:02:50.480 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-28T04:02:50.775 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package jq. 2021-01-28T04:02:50.793 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../75-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2021-01-28T04:02:50.858 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2021-01-28T04:02:51.144 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package socat. 2021-01-28T04:02:51.161 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../76-socat_1.7.3.3-2_amd64.deb ... 2021-01-28T04:02:51.202 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking socat (1.7.3.3-2) ... 2021-01-28T04:02:51.539 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package xmlstarlet. 2021-01-28T04:02:51.556 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../77-xmlstarlet_1.6.1-2build1_amd64.deb ... 2021-01-28T04:02:51.613 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2021-01-28T04:02:51.951 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package ceph-test. 2021-01-28T04:02:51.971 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../78-ceph-test_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:52.009 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:53.424 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-28T04:02:53.442 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:53.480 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:53.933 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package nvme-cli. 2021-01-28T04:02:53.951 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-28T04:02:54.009 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-28T04:02:54.500 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-28T04:02:54.519 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-28T04:02:54.556 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-28T04:02:54.858 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-attr. 2021-01-28T04:02:54.878 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-28T04:02:54.916 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-28T04:02:55.294 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-webencodings. 2021-01-28T04:02:55.315 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-28T04:02:55.360 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-28T04:02:55.680 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-html5lib. 2021-01-28T04:02:55.700 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-28T04:02:55.738 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-28T04:02:56.116 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-28T04:02:56.135 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-28T04:02:56.174 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-28T04:02:56.279 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package libcephfs-dev. 2021-01-28T04:02:56.299 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../79-libcephfs-dev_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:56.356 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:56.669 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-packaging. 2021-01-28T04:02:56.687 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-28T04:02:56.727 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-28T04:02:56.757 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package nvme-cli. 2021-01-28T04:02:56.774 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../80-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2021-01-28T04:02:56.825 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2021-01-28T04:02:57.031 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pastescript. 2021-01-28T04:02:57.048 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-28T04:02:57.089 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-28T04:02:57.389 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-atomicwrites. 2021-01-28T04:02:57.410 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../81-python3-atomicwrites_1.1.5-2build1_all.deb ... 2021-01-28T04:02:57.455 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2021-01-28T04:02:57.459 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pluggy. 2021-01-28T04:02:57.476 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-28T04:02:57.517 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-28T04:02:57.783 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-attr. 2021-01-28T04:02:57.800 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../82-python3-attr_19.3.0-2_all.deb ... 2021-01-28T04:02:57.841 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-attr (19.3.0-2) ... 2021-01-28T04:02:57.845 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-psutil. 2021-01-28T04:02:57.862 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-28T04:02:57.903 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-28T04:02:58.211 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-webencodings. 2021-01-28T04:02:58.231 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../83-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2021-01-28T04:02:58.269 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-28T04:02:58.273 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-py. 2021-01-28T04:02:58.294 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-28T04:02:58.331 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-28T04:02:58.605 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-html5lib. 2021-01-28T04:02:58.626 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../84-python3-html5lib_1.0.1-2_all.deb ... 2021-01-28T04:02:58.651 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-28T04:02:58.668 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-28T04:02:58.680 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2021-01-28T04:02:58.733 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-28T04:02:59.033 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-lxml:amd64. 2021-01-28T04:02:59.045 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-28T04:02:59.050 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../85-python3-lxml_4.5.0-1ubuntu0.2_amd64.deb ... 2021-01-28T04:02:59.066 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-28T04:02:59.091 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-28T04:02:59.103 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-28T04:02:59.439 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package python3-pytest. 2021-01-28T04:02:59.457 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-28T04:02:59.498 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-28T04:02:59.553 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-packaging. 2021-01-28T04:02:59.570 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../86-python3-packaging_20.3-1_all.deb ... 2021-01-28T04:02:59.611 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-packaging (20.3-1) ... 2021-01-28T04:02:59.935 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package radosgw. 2021-01-28T04:02:59.939 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pastescript. 2021-01-28T04:02:59.952 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../94-radosgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:02:59.959 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../87-python3-pastescript_2.0.2-4_all.deb ... 2021-01-28T04:02:59.993 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:02:59.997 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2021-01-28T04:03:00.398 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pluggy. 2021-01-28T04:03:00.419 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../88-python3-pluggy_0.13.0-2_all.deb ... 2021-01-28T04:03:00.467 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2021-01-28T04:03:00.778 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-psutil. 2021-01-28T04:03:00.796 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../89-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2021-01-28T04:03:00.836 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2021-01-28T04:03:01.146 INFO:teuthology.orchestra.run.smithi134.stdout:Selecting previously unselected package rbd-fuse. 2021-01-28T04:03:01.164 INFO:teuthology.orchestra.run.smithi134.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:03:01.204 INFO:teuthology.orchestra.run.smithi134.stdout:Unpacking rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:01.206 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-py. 2021-01-28T04:03:01.225 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../90-python3-py_1.8.1-1_all.deb ... 2021-01-28T04:03:01.264 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-py (1.8.1-1) ... 2021-01-28T04:03:01.509 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-28T04:03:01.576 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pyinotify. 2021-01-28T04:03:01.593 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../91-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2021-01-28T04:03:01.634 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-28T04:03:01.867 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-28T04:03:01.987 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-wcwidth. 2021-01-28T04:03:01.993 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-28T04:03:02.004 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../92-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2021-01-28T04:03:02.045 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-28T04:03:02.136 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-28T04:03:02.362 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:02.373 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package python3-pytest. 2021-01-28T04:03:02.391 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../93-python3-pytest_4.6.9-1_all.deb ... 2021-01-28T04:03:02.448 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking python3-pytest (4.6.9-1) ... 2021-01-28T04:03:02.935 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package radosgw. 2021-01-28T04:03:02.955 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../94-radosgw_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:03:02.993 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:03.030 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user cephadm....done 2021-01-28T04:03:03.193 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-28T04:03:03.596 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-28T04:03:03.871 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-28T04:03:03.999 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-28T04:03:04.181 INFO:teuthology.orchestra.run.smithi150.stdout:Selecting previously unselected package rbd-fuse. 2021-01-28T04:03:04.199 INFO:teuthology.orchestra.run.smithi150.stdout:Preparing to unpack .../95-rbd-fuse_17.0.0-184-g507028cb-1focal_amd64.deb ... 2021-01-28T04:03:04.247 INFO:teuthology.orchestra.run.smithi150.stdout:Unpacking rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:04.334 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-28T04:03:04.578 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-attr (19.3.0-2) ... 2021-01-28T04:03:04.752 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-28T04:03:04.951 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libleveldb1d:amd64 (1.22-3ubuntu2) ... 2021-01-28T04:03:05.037 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-28T04:03:05.077 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2021-01-28T04:03:05.228 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2021-01-28T04:03:05.380 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-28T04:03:05.446 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:05.656 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-28T04:03:06.141 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user cephadm....done 2021-01-28T04:03:06.328 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-waitress (1.4.1-1) ... 2021-01-28T04:03:06.424 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:06.717 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-28T04:03:06.851 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-28T04:03:06.996 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-repoze.lru (0.7-2) ... 2021-01-28T04:03:07.158 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-28T04:03:07.283 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liboath0 (2.6.1-1.3) ... 2021-01-28T04:03:07.408 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-py (1.8.1-1) ... 2021-01-28T04:03:07.470 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-28T04:03:07.785 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-joblib (0.14.0-3) ... 2021-01-28T04:03:07.846 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-28T04:03:08.156 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-28T04:03:08.203 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cachetools (4.0.0-1) ... 2021-01-28T04:03:08.449 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:08.538 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2021-01-28T04:03:08.575 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-28T04:03:08.856 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2021-01-28T04:03:08.943 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-28T04:03:09.140 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2021-01-28T04:03:09.236 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-28T04:03:09.425 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-argparse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:09.537 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-28T04:03:09.663 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-28T04:03:09.801 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2021-01-28T04:03:09.927 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2021-01-28T04:03:09.964 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-28T04:03:10.245 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2021-01-28T04:03:10.383 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-28T04:03:10.571 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2021-01-28T04:03:10.759 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-28T04:03:10.885 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:10.964 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2021-01-28T04:03:11.188 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-28T04:03:11.290 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2021-01-28T04:03:11.591 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjaeger (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:11.648 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-28T04:03:11.725 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2021-01-28T04:03:11.873 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-28T04:03:11.999 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-28T04:03:12.244 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-tempita (0.5.2-6) ... 2021-01-28T04:03:12.276 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-28T04:03:12.577 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-28T04:03:12.578 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-packaging (20.3-1) ... 2021-01-28T04:03:12.887 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2021-01-28T04:03:12.903 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-28T04:03:13.047 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2021-01-28T04:03:13.238 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-28T04:03:13.339 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2021-01-28T04:03:13.530 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-28T04:03:13.781 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2) ... 2021-01-28T04:03:13.849 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:13.975 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-28T04:03:14.101 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-28T04:03:14.143 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up socat (1.7.3.3-2) ... 2021-01-28T04:03:14.294 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:14.402 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-28T04:03:14.603 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-html5lib (1.0.1-2) ... 2021-01-28T04:03:14.711 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-28T04:03:14.963 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2021-01-28T04:03:15.021 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-28T04:03:15.114 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2021-01-28T04:03:15.249 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pluggy (0.13.0-2) ... 2021-01-28T04:03:15.361 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-28T04:03:15.567 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-json-pointer (2.0-0ubuntu1) ... 2021-01-28T04:03:15.615 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-28T04:03:15.766 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-28T04:03:15.843 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.2) ... 2021-01-28T04:03:16.101 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-28T04:03:16.152 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2021-01-28T04:03:16.435 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-28T04:03:16.471 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2021-01-28T04:03:16.795 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-28T04:03:16.805 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-logutils (0.3.3-7) ... 2021-01-28T04:03:16.921 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-28T04:03:17.047 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-28T04:03:17.114 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-modules-core (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:17.241 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2021-01-28T04:03:17.399 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librados2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:17.408 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2021-01-28T04:03:17.525 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-28T04:03:17.676 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-prettytable (0.7.2-5) ... 2021-01-28T04:03:17.977 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2021-01-28T04:03:18.337 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2021-01-28T04:03:18.672 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2021-01-28T04:03:18.973 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2021-01-28T04:03:18.989 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:19.115 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-28T04:03:19.132 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2021-01-28T04:03:19.267 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-28T04:03:19.442 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2) ... 2021-01-28T04:03:19.643 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-28T04:03:19.733 INFO:teuthology.orchestra.run.smithi134.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-28T04:03:19.826 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2021-01-28T04:03:19.953 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-28T04:03:20.194 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjs-underscore (1.9.1~dfsg-1) ... 2021-01-28T04:03:20.230 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-28T04:03:20.345 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2021-01-28T04:03:20.471 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webob (1:1.8.5-2) ... 2021-01-28T04:03:20.631 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:20.757 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:20.847 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librados2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:20.883 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-28T04:03:20.974 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2021-01-28T04:03:21.226 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-28T04:03:22.290 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up librbd1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:22.416 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-28T04:03:22.471 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librgw2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:22.542 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-28T04:03:22.622 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2021-01-28T04:03:22.676 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-28T04:03:22.749 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pytest (4.6.9-1) ... 2021-01-28T04:03:23.011 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-28T04:03:23.159 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-jsonpatch (1.23-3) ... 2021-01-28T04:03:23.248 INFO:teuthology.orchestra.run.smithi150.stdout:update-alternatives: using /usr/bin/jsonpatch-jsondiff to provide /usr/bin/jsondiff (jsondiff) in auto mode 2021-01-28T04:03:23.321 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:23.485 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2021-01-28T04:03:23.547 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-28T04:03:23.547 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-28T04:03:23.828 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-bs4 (4.8.2-1) ... 2021-01-28T04:03:24.006 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:24.166 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-28T04:03:24.212 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs2 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:24.372 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libradosstriper1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:24.498 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2021-01-28T04:03:24.500 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-28T04:03:24.870 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:24.883 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2021-01-28T04:03:24.995 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:25.121 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:25.248 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-28T04:03:25.582 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-28T04:03:25.892 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:25.896 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up librbd1 (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:26.018 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:26.022 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2021-01-28T04:03:26.144 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-28T04:03:26.182 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2021-01-28T04:03:26.325 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rsa (4.0-3) ... 2021-01-28T04:03:26.634 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-webtest (2.0.32-2) ... 2021-01-28T04:03:26.969 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:27.089 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:27.200 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-28T04:03:27.200 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2021-01-28T04:03:27.695 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up libcephfs-dev (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:27.753 INFO:teuthology.orchestra.run.smithi134.stdout:Adding group ceph....done 2021-01-28T04:03:27.855 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pastescript (2.0.2-4) ... 2021-01-28T04:03:28.121 INFO:teuthology.orchestra.run.smithi134.stdout:Adding system user ceph....done 2021-01-28T04:03:28.173 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2021-01-28T04:03:28.331 INFO:teuthology.orchestra.run.smithi134.stdout:Setting system user ceph properties....done 2021-01-28T04:03:28.545 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-28T04:03:28.577 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rados (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:28.709 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rbd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:28.874 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-28T04:03:28.877 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up rbd-fuse (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:29.003 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-routes (2.4.1-2) ... 2021-01-28T04:03:29.360 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:29.379 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-google-auth (1.5.1-2) ... 2021-01-28T04:03:29.486 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:29.697 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-rgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:29.764 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-28T04:03:29.764 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-28T04:03:29.862 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-cephfs (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:29.991 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2021-01-28T04:03:30.497 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:30.832 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-28T04:03:30.903 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-common (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:31.315 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:31.534 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-28T04:03:31.534 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-28T04:03:31.650 INFO:teuthology.orchestra.run.smithi150.stdout:Adding group ceph....done 2021-01-28T04:03:32.042 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:32.059 INFO:teuthology.orchestra.run.smithi150.stdout:Adding system user ceph....done 2021-01-28T04:03:32.277 INFO:teuthology.orchestra.run.smithi150.stdout:Setting system user ceph properties....done 2021-01-28T04:03:32.280 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-28T04:03:32.280 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-28T04:03:32.486 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2021-01-28T04:03:32.760 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:32.807 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2021-01-28T04:03:32.903 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:33.290 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-test (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:33.441 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up radosgw (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:33.451 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-28T04:03:33.451 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-28T04:03:33.713 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-28T04:03:33.714 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2021-01-28T04:03:33.922 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:34.098 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:34.241 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:34.418 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-base (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:34.472 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-28T04:03:34.472 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-28T04:03:34.756 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2021-01-28T04:03:34.950 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:35.110 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:35.236 INFO:teuthology.orchestra.run.smithi134.stdout:Setting up ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:35.236 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mds (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:35.397 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-28T04:03:35.465 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-28T04:03:35.466 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2021-01-28T04:03:35.705 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-28T04:03:35.938 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:36.172 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-28T04:03:36.173 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2021-01-28T04:03:36.648 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-rook (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:36.791 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-osd (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:37.354 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-28T04:03:37.354 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2021-01-28T04:03:38.201 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-k8sevents (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:38.461 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-diskprediction-local (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:38.603 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mon (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:38.775 INFO:teuthology.orchestra.run.smithi134.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-28T04:03:38.861 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-28T04:03:38.862 INFO:teuthology.orchestra.run.smithi150.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2021-01-28T04:03:39.218 INFO:teuthology.orchestra.run.smithi134.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-28T04:03:39.221 DEBUG:teuthology.parallel:result is None 2021-01-28T04:03:39.338 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-cephadm (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:39.506 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:39.624 INFO:teuthology.orchestra.run.smithi150.stdout:Setting up ceph-mgr-dashboard (17.0.0-184-g507028cb-1focal) ... 2021-01-28T04:03:39.776 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for systemd (245.4-4ubuntu3.4) ... 2021-01-28T04:03:40.077 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for man-db (2.9.1-1) ... 2021-01-28T04:03:43.204 INFO:teuthology.orchestra.run.smithi150.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.1) ... 2021-01-28T04:03:43.634 INFO:teuthology.orchestra.run.smithi150.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2021-01-28T04:03:43.637 DEBUG:teuthology.parallel:result is None 2021-01-28T04:03:43.639 DEBUG:teuthology.orchestra.run.smithi150:> sudo lsb_release -is 2021-01-28T04:03:43.683 INFO:teuthology.orchestra.run.smithi150.stdout:Ubuntu 2021-01-28T04:03:43.688 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T04:03:43.689 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:03:43.867 DEBUG:teuthology.orchestra.run.smithi150:> dpkg-query -W -f '${Version}' ceph 2021-01-28T04:03:43.893 INFO:teuthology.orchestra.run.smithi150.stdout:17.0.0-184-g507028cb-1focal 2021-01-28T04:03:43.894 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-184-g507028cb-1focal 2021-01-28T04:03:43.895 INFO:teuthology.task.install:The correct ceph version 17.0.0-184-g507028cb-1focal is installed. 2021-01-28T04:03:43.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo lsb_release -is 2021-01-28T04:03:43.947 INFO:teuthology.orchestra.run.smithi134.stdout:Ubuntu 2021-01-28T04:03:43.952 DEBUG:teuthology.misc:System to be installed: Ubuntu 2021-01-28T04:03:43.953 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:03:44.141 DEBUG:teuthology.orchestra.run.smithi134:> dpkg-query -W -f '${Version}' ceph 2021-01-28T04:03:44.174 INFO:teuthology.orchestra.run.smithi134.stdout:17.0.0-184-g507028cb-1focal 2021-01-28T04:03:44.175 INFO:teuthology.packaging:The installed version of ceph is 17.0.0-184-g507028cb-1focal 2021-01-28T04:03:44.176 INFO:teuthology.task.install:The correct ceph version 17.0.0-184-g507028cb-1focal is installed. 2021-01-28T04:03:44.177 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2021-01-28T04:03:44.179 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:03:44.180 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-28T04:03:44.209 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:03:44.214 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2021-01-28T04:03:44.235 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2021-01-28T04:03:44.236 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:03:44.236 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/daemon-helper 2021-01-28T04:03:44.296 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-28T04:03:44.390 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:03:44.391 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2021-01-28T04:03:44.409 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2021-01-28T04:03:44.470 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2021-01-28T04:03:44.470 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:03:44.471 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-28T04:03:44.528 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-28T04:03:44.635 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:03:44.636 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2021-01-28T04:03:44.657 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2021-01-28T04:03:44.719 INFO:teuthology.run_tasks:Running task cephadm... 2021-01-28T04:03:44.878 INFO:tasks.cephadm:Config: {'conf': {'mgr': {'debug mgr': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 1, 'ms type': 'async'}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'osd shutdown pgref assert': True}}, 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'but it is still running', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(PG_', '\\(OSD_', '\\(OBJECT_', '\\(POOL_APP_NOT_ENABLED\\)'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '507028cb839c25d6666833702df6325fd8569096', 'cephadm_mode': 'root'} 2021-01-28T04:03:44.878 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:03:44.884 INFO:tasks.cephadm:Cluster fsid is d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:03:44.887 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2021-01-28T04:03:44.889 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.150', 'mon.c': '[v2:172.21.15.150:3301,v1:172.21.15.150:6790]', 'mon.b': '172.21.15.134'} 2021-01-28T04:03:44.892 INFO:tasks.cephadm:First mon is mon.a on smithi150 2021-01-28T04:03:44.895 INFO:tasks.cephadm:First mgr is y 2021-01-28T04:03:44.896 INFO:tasks.cephadm:Normalizing hostnames... 2021-01-28T04:03:44.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2021-01-28T04:03:44.923 DEBUG:teuthology.orchestra.run.smithi150:> sudo hostname $(hostname -s) 2021-01-28T04:03:44.958 INFO:tasks.cephadm:Downloading cephadm (repo git://git.ceph.com/ceph-ci.git ref 507028cb839c25d6666833702df6325fd8569096)... 2021-01-28T04:03:44.959 DEBUG:teuthology.orchestra.run.smithi134:> git archive --remote=git://git.ceph.com/ceph-ci.git 507028cb839c25d6666833702df6325fd8569096 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2021-01-28T04:03:45.080 DEBUG:teuthology.orchestra.run.smithi150:> git archive --remote=git://git.ceph.com/ceph-ci.git 507028cb839c25d6666833702df6325fd8569096 src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm 2021-01-28T04:03:45.192 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-01-28T04:03:45.205 DEBUG:teuthology.orchestra.run.smithi150:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2021-01-28T04:03:45.923 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2021-01-28T04:03:45.956 DEBUG:teuthology.orchestra.run.smithi150:> sudo mkdir -p /etc/ceph 2021-01-28T04:03:45.979 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2021-01-28T04:03:45.997 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 777 /etc/ceph 2021-01-28T04:03:46.017 INFO:tasks.cephadm:Adding local image mirror docker-mirror.front.sepia.ceph.com:5000 2021-01-28T04:03:46.018 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:03:46.020 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-28T04:03:46.068 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-28T04:03:46.069 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi150.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-28T04:03:46.070 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:03:46.071 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/etc/containers/registries.conf of=/dev/stdout 2021-01-28T04:03:46.082 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-28T04:03:46.083 INFO:tasks.cephadm:Failed to add mirror: [Errno 2] Cannot find file on the remote 'ubuntu@smithi134.front.sepia.ceph.com': '/etc/containers/registries.conf' 2021-01-28T04:03:46.085 INFO:tasks.cephadm:Writing seed config... 2021-01-28T04:03:46.088 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2021-01-28T04:03:46.088 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2021-01-28T04:03:46.088 INFO:tasks.cephadm: override: [global] mon election default strategy = 1 2021-01-28T04:03:46.089 INFO:tasks.cephadm: override: [global] ms type = async 2021-01-28T04:03:46.089 INFO:tasks.cephadm: override: [mon] debug mon = 20 2021-01-28T04:03:46.089 INFO:tasks.cephadm: override: [mon] debug ms = 1 2021-01-28T04:03:46.090 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2021-01-28T04:03:46.090 INFO:tasks.cephadm: override: [osd] debug filestore = 20 2021-01-28T04:03:46.090 INFO:tasks.cephadm: override: [osd] debug journal = 20 2021-01-28T04:03:46.090 INFO:tasks.cephadm: override: [osd] debug ms = 20 2021-01-28T04:03:46.091 INFO:tasks.cephadm: override: [osd] debug osd = 25 2021-01-28T04:03:46.091 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2021-01-28T04:03:46.092 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:03:46.092 DEBUG:teuthology.orchestra.run.smithi150:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2021-01-28T04:03:46.100 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = d0bb049a-611d-11eb-8f9e-001a4aab830c mon election default strategy = 1 ms type = async [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true debug filestore = 20 debug journal = 20 debug ms = 20 debug osd = 25 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2021-01-28T04:03:46.101 DEBUG:teuthology.orchestra.run.smithi150:mon.a> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a.service 2021-01-28T04:03:46.146 DEBUG:teuthology.orchestra.run.smithi150:mgr.y> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.y.service 2021-01-28T04:03:46.150 INFO:tasks.cephadm:Bootstrapping... 2021-01-28T04:03:46.150 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -v bootstrap --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.150 && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2021-01-28T04:03:46.210 INFO:journalctl@ceph.mon.a.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:03:46.220 INFO:journalctl@ceph.mgr.y.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:03:46.472 INFO:teuthology.orchestra.run.smithi150.stderr:Could not locate podman: podman not found 2021-01-28T04:03:46.472 INFO:teuthology.orchestra.run.smithi150.stderr:Verifying podman|docker is present... 2021-01-28T04:03:46.473 INFO:teuthology.orchestra.run.smithi150.stderr:Verifying lvm2 is present... 2021-01-28T04:03:46.473 INFO:teuthology.orchestra.run.smithi150.stderr:Verifying time synchronization is in place... 2021-01-28T04:03:46.473 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled chrony.service 2021-01-28T04:03:46.479 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-01-28T04:03:46.480 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active chrony.service 2021-01-28T04:03:46.485 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: inactive 2021-01-28T04:03:46.486 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-28T04:03:46.492 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-01-28T04:03:46.492 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active chronyd.service 2021-01-28T04:03:46.497 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: inactive 2021-01-28T04:03:46.498 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-28T04:03:46.503 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: masked 2021-01-28T04:03:46.504 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-28T04:03:46.509 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: inactive 2021-01-28T04:03:46.510 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-28T04:03:46.517 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-01-28T04:03:46.517 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active ntpd.service 2021-01-28T04:03:46.523 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: inactive 2021-01-28T04:03:46.524 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled ntp.service 2021-01-28T04:03:46.530 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: enabled 2021-01-28T04:03:46.531 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active ntp.service 2021-01-28T04:03:46.537 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: active 2021-01-28T04:03:46.538 INFO:teuthology.orchestra.run.smithi150.stderr:Unit ntp.service is enabled and running 2021-01-28T04:03:46.539 INFO:teuthology.orchestra.run.smithi150.stderr:Repeating the final host check... 2021-01-28T04:03:46.539 INFO:teuthology.orchestra.run.smithi150.stderr:podman|docker (/usr/bin/docker) is present 2021-01-28T04:03:46.539 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl is present 2021-01-28T04:03:46.540 INFO:teuthology.orchestra.run.smithi150.stderr:lvcreate is present 2021-01-28T04:03:46.540 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled chrony.service 2021-01-28T04:03:46.544 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2021-01-28T04:03:46.545 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active chrony.service 2021-01-28T04:03:46.551 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: inactive 2021-01-28T04:03:46.552 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled chronyd.service 2021-01-28T04:03:46.557 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Failed to get unit file state for chronyd.service: No such file or directory 2021-01-28T04:03:46.558 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active chronyd.service 2021-01-28T04:03:46.564 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: inactive 2021-01-28T04:03:46.565 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled systemd-timesyncd.service 2021-01-28T04:03:46.570 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: masked 2021-01-28T04:03:46.571 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active systemd-timesyncd.service 2021-01-28T04:03:46.576 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: inactive 2021-01-28T04:03:46.577 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled ntpd.service 2021-01-28T04:03:46.582 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Failed to get unit file state for ntpd.service: No such file or directory 2021-01-28T04:03:46.583 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active ntpd.service 2021-01-28T04:03:46.588 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: inactive 2021-01-28T04:03:46.589 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-enabled ntp.service 2021-01-28T04:03:46.595 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: enabled 2021-01-28T04:03:46.596 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl is-active ntp.service 2021-01-28T04:03:46.601 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: active 2021-01-28T04:03:46.603 INFO:teuthology.orchestra.run.smithi150.stderr:Unit ntp.service is enabled and running 2021-01-28T04:03:46.603 INFO:teuthology.orchestra.run.smithi150.stderr:Host looks OK 2021-01-28T04:03:46.603 INFO:teuthology.orchestra.run.smithi150.stderr:Cluster fsid: d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:03:46.604 INFO:teuthology.orchestra.run.smithi150.stderr:Acquiring lock 140209774267456 on /run/cephadm/d0bb049a-611d-11eb-8f9e-001a4aab830c.lock 2021-01-28T04:03:46.604 INFO:teuthology.orchestra.run.smithi150.stderr:Lock 140209774267456 acquired on /run/cephadm/d0bb049a-611d-11eb-8f9e-001a4aab830c.lock 2021-01-28T04:03:46.606 INFO:teuthology.orchestra.run.smithi150.stderr:Verifying IP 172.21.15.150 port 3300 ... 2021-01-28T04:03:46.606 INFO:teuthology.orchestra.run.smithi150.stderr:Verifying IP 172.21.15.150 port 6789 ... 2021-01-28T04:03:46.606 INFO:teuthology.orchestra.run.smithi150.stderr:Base mon IP is 172.21.15.150, final addrv is [v2:172.21.15.150:3300,v1:172.21.15.150:6789] 2021-01-28T04:03:46.607 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/sbin/ip route ls 2021-01-28T04:03:46.608 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: default via 172.21.15.254 dev enp3s0f1 2021-01-28T04:03:46.609 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.150 metric 100 2021-01-28T04:03:46.609 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: 172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 linkdown 2021-01-28T04:03:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.150 2021-01-28T04:03:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: 172.21.15.254 dev enp3s0f1 proto dhcp scope link src 172.21.15.150 metric 100 2021-01-28T04:03:46.610 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/sbin/ip -6 route ls 2021-01-28T04:03:46.612 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2021-01-28T04:03:46.612 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2021-01-28T04:03:46.612 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 expires 1769sec pref medium 2021-01-28T04:03:46.613 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/sbin/ip -6 addr ls 2021-01-28T04:03:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2021-01-28T04:03:46.616 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: inet6 ::1/128 scope host 2021-01-28T04:03:46.617 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-01-28T04:03:46.617 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2021-01-28T04:03:46.618 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: inet6 fe80::ec4:7aff:fe88:6e35/64 scope link 2021-01-28T04:03:46.618 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/sbin/ip: valid_lft forever preferred_lft forever 2021-01-28T04:03:46.619 INFO:teuthology.orchestra.run.smithi150.stderr:Mon IP 172.21.15.150 is in CIDR network 172.21.0.0/20 2021-01-28T04:03:46.620 INFO:teuthology.orchestra.run.smithi150.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096... 2021-01-28T04:03:46.620 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker pull quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:03:47.603 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 507028cb839c25d6666833702df6325fd8569096: Pulling from ceph-ci/ceph 2021-01-28T04:03:47.604 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 889524391d55: Pulling fs layer 2021-01-28T04:03:47.604 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 4c303d906d85: Pulling fs layer 2021-01-28T04:03:48.286 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 889524391d55: Verifying Checksum 2021-01-28T04:03:48.287 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 889524391d55: Download complete 2021-01-28T04:03:50.148 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 4c303d906d85: Verifying Checksum 2021-01-28T04:03:50.148 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 4c303d906d85: Download complete 2021-01-28T04:03:50.802 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 889524391d55: Pull complete 2021-01-28T04:04:00.492 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: 4c303d906d85: Pull complete 2021-01-28T04:04:00.566 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: Digest: sha256:c489442ef6855dff2d8ef5c2bf059a3e3799787d2dd370f561e71fe7fd43e3ef 2021-01-28T04:04:00.618 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: Status: Downloaded newer image for quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:04:00.619 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/docker: quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:04:00.622 INFO:teuthology.orchestra.run.smithi150.stderr:Extracting ceph user uid/gid from container image... 2021-01-28T04:04:00.623 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint stat -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -c %u %g /var/lib/ceph 2021-01-28T04:04:12.310 INFO:teuthology.orchestra.run.smithi150.stderr:stat: 167 167 2021-01-28T04:04:12.925 INFO:teuthology.orchestra.run.smithi150.stderr:Creating initial keys... 2021-01-28T04:04:12.926 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-28T04:04:13.985 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-authtool: AQC9NxJg0/3lOhAAv23axT6p4pQIjAuvbUN+ug== 2021-01-28T04:04:14.570 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-28T04:04:15.569 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-authtool: AQC/NxJgQLIdIhAAWZ3lQmIQi/6Guhp6naWfHg== 2021-01-28T04:04:16.176 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-authtool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --gen-print-key 2021-01-28T04:04:17.111 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-authtool: AQDBNxJg1grXBhAAsqJp5ie4DEacdOtoAE3uIw== 2021-01-28T04:04:17.658 INFO:teuthology.orchestra.run.smithi150.stderr:Creating initial monmap... 2021-01-28T04:04:17.658 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/monmaptool -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /tmp/ceph-tmp2u33sn3c:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --create --clobber --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c --addv a [v2:172.21.15.150:3300,v1:172.21.15.150:6789] /tmp/monmap 2021-01-28T04:04:18.630 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-28T04:04:18.631 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:18.631 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-28T04:04:19.266 INFO:teuthology.orchestra.run.smithi150.stderr:monmaptool for a [v2:172.21.15.150:3300,v1:172.21.15.150:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2021-01-28T04:04:19.267 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/monmaptool: set fsid to d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:19.267 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2021-01-28T04:04:19.268 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:04:19.268 INFO:teuthology.orchestra.run.smithi150.stderr:Creating mon... 2021-01-28T04:04:19.269 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph-mon -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmpt9ynlg10:/tmp/keyring:z -v /tmp/ceph-tmp2u33sn3c:/tmp/monmap:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 --mkfs -i a --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -c /dev/null --monmap /tmp/monmap --keyring /tmp/keyring --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix="debug " --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true 2021-01-28T04:04:20.308 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.258+0000 7f58c9aa9700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-28T04:04:20.309 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.258+0000 7f58c9aa9700 1 imported monmap: 2021-01-28T04:04:20.309 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: epoch 0 2021-01-28T04:04:20.309 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: fsid d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:20.310 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: last_changed 2021-01-28T04:04:18.633601+0000 2021-01-28T04:04:20.310 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: created 2021-01-28T04:04:18.633601+0000 2021-01-28T04:04:20.310 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2021-01-28T04:04:20.311 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: election_strategy: 1 2021-01-28T04:04:20.311 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon.a 2021-01-28T04:04:20.311 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.311 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.258+0000 7f58c9aa9700 0 /usr/bin/ceph-mon: set fsid to d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:20.312 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: RocksDB version: 6.8.1 2021-01-28T04:04:20.312 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.312 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-28T04:04:20.313 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Compile date Jan 27 2021 2021-01-28T04:04:20.313 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: DB SUMMARY 2021-01-28T04:04:20.313 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.313 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 0, files: 2021-01-28T04:04:20.314 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.314 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 2021-01-28T04:04:20.314 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.314 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.error_if_exists: 0 2021-01-28T04:04:20.314 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.create_if_missing: 1 2021-01-28T04:04:20.315 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.paranoid_checks: 1 2021-01-28T04:04:20.315 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.env: 0x5651296191c0 2021-01-28T04:04:20.315 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.fs: Posix File System 2021-01-28T04:04:20.315 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.info_log: 0x56512abc0920 2021-01-28T04:04:20.315 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-28T04:04:20.316 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.statistics: (nil) 2021-01-28T04:04:20.316 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.use_fsync: 0 2021-01-28T04:04:20.316 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_log_file_size: 0 2021-01-28T04:04:20.316 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-28T04:04:20.316 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-28T04:04:20.317 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-28T04:04:20.317 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-28T04:04:20.317 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.allow_fallocate: 1 2021-01-28T04:04:20.317 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-28T04:04:20.317 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-28T04:04:20.318 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.use_direct_reads: 0 2021-01-28T04:04:20.318 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-28T04:04:20.318 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-28T04:04:20.318 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.db_log_dir: 2021-01-28T04:04:20.318 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-28T04:04:20.319 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-28T04:04:20.319 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_subcompactions: 1 2021-01-28T04:04:20.319 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_background_flushes: -1 2021-01-28T04:04:20.319 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-28T04:04:20.319 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-28T04:04:20.320 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-28T04:04:20.320 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-28T04:04:20.320 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-28T04:04:20.320 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-28T04:04:20.320 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-28T04:04:20.321 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.write_buffer_manager: 0x56512ab871d0 2021-01-28T04:04:20.321 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-28T04:04:20.321 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-28T04:04:20.321 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-28T04:04:20.322 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-28T04:04:20.322 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-28T04:04:20.322 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-28T04:04:20.322 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-28T04:04:20.322 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-28T04:04:20.323 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-28T04:04:20.323 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.unordered_write: 0 2021-01-28T04:04:20.323 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-28T04:04:20.323 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-28T04:04:20.323 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-28T04:04:20.324 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-28T04:04:20.324 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.row_cache: None 2021-01-28T04:04:20.324 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.wal_filter: None 2021-01-28T04:04:20.324 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-28T04:04:20.324 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-28T04:04:20.325 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.preserve_deletes: 0 2021-01-28T04:04:20.325 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.two_write_queues: 0 2021-01-28T04:04:20.325 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-28T04:04:20.325 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.atomic_flush: 0 2021-01-28T04:04:20.326 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-28T04:04:20.326 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-28T04:04:20.326 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-28T04:04:20.326 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.log_readahead_size: 0 2021-01-28T04:04:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-28T04:04:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_background_jobs: 2 2021-01-28T04:04:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_background_compactions: -1 2021-01-28T04:04:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-28T04:04:20.327 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-28T04:04:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-28T04:04:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-28T04:04:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-28T04:04:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-28T04:04:20.328 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-28T04:04:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-28T04:04:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.max_open_files: -1 2021-01-28T04:04:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-28T04:04:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-28T04:04:20.329 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-28T04:04:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-28T04:04:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Compression algorithms supported: 2021-01-28T04:04:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-28T04:04:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: kZSTD supported: 0 2021-01-28T04:04:20.330 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: kXpressCompression supported: 0 2021-01-28T04:04:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-28T04:04:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: kLZ4Compression supported: 1 2021-01-28T04:04:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: kBZip2Compression supported: 0 2021-01-28T04:04:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: kZlibCompression supported: 1 2021-01-28T04:04:20.331 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: kSnappyCompression supported: 1 2021-01-28T04:04:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-28T04:04:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.262+0000 7f58c9aa9700 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2021-01-28T04:04:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 2021-01-28T04:04:20.332 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.333 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-28T04:04:20.333 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.333 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-28T04:04:20.333 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.merge_operator: 2021-01-28T04:04:20.333 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_filter: None 2021-01-28T04:04:20.334 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-28T04:04:20.334 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-28T04:04:20.334 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-28T04:04:20.334 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56512aad61c8) 2021-01-28T04:04:20.335 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2021-01-28T04:04:20.335 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-28T04:04:20.335 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-28T04:04:20.335 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2021-01-28T04:04:20.335 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: index_type: 0 2021-01-28T04:04:20.336 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2021-01-28T04:04:20.336 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: index_shortening: 1 2021-01-28T04:04:20.336 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2021-01-28T04:04:20.336 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2021-01-28T04:04:20.336 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: checksum: 1 2021-01-28T04:04:20.337 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2021-01-28T04:04:20.337 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: block_cache: 0x56512ab0e110 2021-01-28T04:04:20.337 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2021-01-28T04:04:20.337 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: block_cache_options: 2021-01-28T04:04:20.337 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: capacity : 536870912 2021-01-28T04:04:20.338 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2021-01-28T04:04:20.338 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2021-01-28T04:04:20.338 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2021-01-28T04:04:20.338 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2021-01-28T04:04:20.338 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2021-01-28T04:04:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: block_size: 4096 2021-01-28T04:04:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2021-01-28T04:04:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2021-01-28T04:04:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2021-01-28T04:04:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2021-01-28T04:04:20.339 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: partition_filters: 0 2021-01-28T04:04:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2021-01-28T04:04:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-28T04:04:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2021-01-28T04:04:20.340 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: verify_compression: 0 2021-01-28T04:04:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2021-01-28T04:04:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: format_version: 2 2021-01-28T04:04:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2021-01-28T04:04:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: block_align: 0 2021-01-28T04:04:20.341 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-28T04:04:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-28T04:04:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compression: NoCompression 2021-01-28T04:04:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-28T04:04:20.342 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-28T04:04:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-28T04:04:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.num_levels: 7 2021-01-28T04:04:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-28T04:04:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-28T04:04:20.343 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-28T04:04:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-28T04:04:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-28T04:04:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-28T04:04:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-28T04:04:20.344 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-28T04:04:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-28T04:04:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-28T04:04:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-28T04:04:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-28T04:04:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-28T04:04:20.345 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-28T04:04:20.346 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-28T04:04:20.346 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-28T04:04:20.346 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-28T04:04:20.346 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-28T04:04:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-28T04:04:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-28T04:04:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-28T04:04:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-28T04:04:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-28T04:04:20.347 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-28T04:04:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-28T04:04:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-28T04:04:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-28T04:04:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-28T04:04:20.348 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-28T04:04:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-28T04:04:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-28T04:04:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-28T04:04:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-28T04:04:20.349 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-28T04:04:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-28T04:04:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-28T04:04:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-28T04:04:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-28T04:04:20.350 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-28T04:04:20.351 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-28T04:04:20.351 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-28T04:04:20.351 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-28T04:04:20.351 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-28T04:04:20.351 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-28T04:04:20.352 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-28T04:04:20.352 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-28T04:04:20.352 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-28T04:04:20.352 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.table_properties_collectors: 2021-01-28T04:04:20.352 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.inplace_update_support: 0 2021-01-28T04:04:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-28T04:04:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-28T04:04:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-28T04:04:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-28T04:04:20.353 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.bloom_locality: 0 2021-01-28T04:04:20.354 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.max_successive_merges: 0 2021-01-28T04:04:20.354 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-28T04:04:20.354 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-28T04:04:20.354 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-28T04:04:20.354 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-28T04:04:20.355 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.ttl: 2592000 2021-01-28T04:04:20.355 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-28T04:04:20.355 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-28T04:04:20.355 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.266+0000 7f58c9aa9700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-28T04:04:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.270+0000 7f58c9aa9700 4 rocksdb: DB pointer 0x56512abcd800 2021-01-28T04:04:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.270+0000 7f58b294b700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-28T04:04:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.270+0000 7f58b294b700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-28T04:04:20.356 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2021-01-28T04:04:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:04:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-28T04:04:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-28T04:04:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T04:04:20.357 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-28T04:04:20.358 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-28T04:04:20.358 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T04:04:20.358 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.358 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-28T04:04:20.358 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:04:20.359 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:04:20.359 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T04:04:20.359 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T04:04:20.359 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.360 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-28T04:04:20.360 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:04:20.360 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:04:20.360 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:04:20.360 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T04:04:20.361 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T04:04:20.361 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T04:04:20.361 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T04:04:20.361 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-01-28T04:04:20.361 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:04:20.361 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:04:20.362 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T04:04:20.362 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.362 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-01-28T04:04:20.362 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.362 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-28T04:04:20.363 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:04:20.363 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:04:20.363 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T04:04:20.363 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T04:04:20.364 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.364 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2021-01-28T04:04:20.364 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:04:20.364 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:04:20.364 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:04:20.365 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T04:04:20.365 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T04:04:20.365 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T04:04:20.365 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T04:04:20.365 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2021-01-28T04:04:20.366 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:04:20.366 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:04:20.366 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T04:04:20.366 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.366 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2021-01-28T04:04:20.367 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: 2021-01-28T04:04:20.367 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.274+0000 7f58c9aa9700 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2021-01-28T04:04:20.367 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.274+0000 7f58c9aa9700 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2021-01-28T04:04:20.367 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph-mon: "debug "2021-01-28T04:04:20.274+0000 7f58c9aa9700 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-a for mon.a 2021-01-28T04:04:20.829 INFO:teuthology.orchestra.run.smithi150.stderr:create mon.a on 2021-01-28T04:04:20.829 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: install -d -m0770 -o 167 -g 167 /var/run/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:20.835 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl disable ceph.target 2021-01-28T04:04:20.857 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2021-01-28T04:04:21.053 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl enable ceph.target 2021-01-28T04:04:21.059 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /etc/systemd/system/ceph.target. 2021-01-28T04:04:21.268 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl start ceph.target 2021-01-28T04:04:21.277 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl enable ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c.target 2021-01-28T04:04:21.295 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c.target -> /etc/systemd/system/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c.target. 2021-01-28T04:04:21.295 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c.target -> /etc/systemd/system/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c.target. 2021-01-28T04:04:21.513 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl start ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c.target 2021-01-28T04:04:21.521 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl daemon-reload 2021-01-28T04:04:21.740 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl stop ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T04:04:21.751 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl reset-failed ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T04:04:21.757 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Failed to reset failed state of unit ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a.service: Unit ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a.service not loaded. 2021-01-28T04:04:21.757 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl enable ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T04:04:21.763 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Created symlink /etc/systemd/system/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c.target.wants/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a.service -> /etc/systemd/system/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@.service. 2021-01-28T04:04:21.979 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl start ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T04:04:21.993 INFO:teuthology.orchestra.run.smithi150.stderr:firewalld does not appear to be present 2021-01-28T04:04:21.994 INFO:teuthology.orchestra.run.smithi150.stderr:Not possible to enable service . firewalld.service is not available 2021-01-28T04:04:21.994 INFO:teuthology.orchestra.run.smithi150.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-28T04:04:21.995 INFO:teuthology.orchestra.run.smithi150.stderr:Waiting for mon to start... 2021-01-28T04:04:21.995 INFO:teuthology.orchestra.run.smithi150.stderr:Waiting for mon... 2021-01-28T04:04:21.995 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status 2021-01-28T04:04:23.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:23 smithi150 bash[9405]: cluster 2021-01-28T04:04:23.587347+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-28T04:04:24.802 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: cluster: 2021-01-28T04:04:24.802 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: id: d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:24.803 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: health: HEALTH_OK 2021-01-28T04:04:24.803 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:24.803 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: services: 2021-01-28T04:04:24.803 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 1.17018s) 2021-01-28T04:04:24.803 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: mgr: no daemons active 2021-01-28T04:04:24.804 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2021-01-28T04:04:24.804 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:24.804 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: data: 2021-01-28T04:04:24.804 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2021-01-28T04:04:24.804 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2021-01-28T04:04:24.805 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2021-01-28T04:04:24.805 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: pgs: 2021-01-28T04:04:24.805 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:24.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:24 smithi150 bash[9405]: cluster 2021-01-28T04:04:23.618773+0000 mon.a (mon.0) 2 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-28T04:04:24.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:24 smithi150 bash[9405]: cluster 2021-01-28T04:04:23.619154+0000 mon.a (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0]} 2021-01-28T04:04:24.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:24 smithi150 bash[9405]: cluster 2021-01-28T04:04:23.623147+0000 mon.a (mon.0) 4 : cluster [DBG] fsmap 2021-01-28T04:04:24.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:24 smithi150 bash[9405]: cluster 2021-01-28T04:04:23.632563+0000 mon.a (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-28T04:04:24.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:24 smithi150 bash[9405]: cluster 2021-01-28T04:04:23.634154+0000 mon.a (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2021-01-28T04:04:25.643 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:25 smithi150 bash[9405]: audit 2021-01-28T04:04:24.788765+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.150:0/1138704362' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2021-01-28T04:04:25.832 INFO:teuthology.orchestra.run.smithi150.stderr:mon is available 2021-01-28T04:04:25.833 INFO:teuthology.orchestra.run.smithi150.stderr:Assimilating anything we can from ceph.conf... 2021-01-28T04:04:25.834 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z -v /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config assimilate-conf -i /var/lib/ceph/mon/ceph-a/config 2021-01-28T04:04:29.298 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:29.299 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: [global] 2021-01-28T04:04:29.299 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: fsid = d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:29.299 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.150:3300,v1:172.21.15.150:6789] 2021-01-28T04:04:29.299 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2021-01-28T04:04:29.300 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2021-01-28T04:04:29.300 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2021-01-28T04:04:29.300 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2021-01-28T04:04:29.300 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:29.300 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: [mgr] 2021-01-28T04:04:29.301 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2021-01-28T04:04:29.301 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:29.301 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: [osd] 2021-01-28T04:04:29.302 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2021-01-28T04:04:29.302 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2021-01-28T04:04:29.839 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:29 smithi150 bash[9405]: audit 2021-01-28T04:04:29.259668+0000 mon.a (mon.0) 8 : audit [INF] from='client.? 172.21.15.150:0/3346656409' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2021-01-28T04:04:29.839 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:29 smithi150 bash[9405]: audit 2021-01-28T04:04:29.285102+0000 mon.a (mon.0) 9 : audit [INF] from='client.? 172.21.15.150:0/3346656409' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2021-01-28T04:04:30.250 INFO:teuthology.orchestra.run.smithi150.stderr:Generating new minimal ceph.conf... 2021-01-28T04:04:30.252 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z -v /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a:/var/lib/ceph/mon/ceph-a:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config generate-minimal-conf -o /var/lib/ceph/mon/ceph-a/config 2021-01-28T04:04:33.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:33 smithi150 bash[9405]: audit 2021-01-28T04:04:33.519718+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.150:0/2436247335' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:04:34.108 INFO:teuthology.orchestra.run.smithi150.stderr:Restarting the monitor... 2021-01-28T04:04:34.146 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl restart ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a 2021-01-28T04:04:34.471 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:34 smithi150 systemd[1]: Stopping Ceph mon.a for d0bb049a-611d-11eb-8f9e-001a4aab830c... 2021-01-28T04:04:34.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:34 smithi150 bash[9405]: debug 2021-01-28T04:04:34.230+0000 7fc169b1a700 -1 received signal: Terminated from Kernel ( Could be generated by pthread_kill(), raise(), abort(), alarm() ) UID: 0 2021-01-28T04:04:34.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:34 smithi150 bash[9405]: debug 2021-01-28T04:04:34.230+0000 7fc169b1a700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2021-01-28T04:04:35.049 INFO:teuthology.orchestra.run.smithi150.stderr:Setting mon public_network... 2021-01-28T04:04:35.050 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config set mon public_network 172.21.0.0/20 2021-01-28T04:04:35.095 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:35 smithi150 docker[9720]: ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c-mon.a 2021-01-28T04:04:35.095 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:35 smithi150 systemd[1]: ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.a.service: Succeeded. 2021-01-28T04:04:35.095 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:35 smithi150 systemd[1]: Stopped Ceph mon.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:04:35.096 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:35 smithi150 systemd[1]: Started Ceph mon.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:04:36.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.450+0000 7f9c425c6700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-28T04:04:36.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.450+0000 7f9c425c6700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-28T04:04:36.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.450+0000 7f9c425c6700 0 pidfile_write: ignore empty --pid-file 2021-01-28T04:04:36.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 0 load: jerasure load: lrc load: isa 2021-01-28T04:04:36.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: RocksDB version: 6.8.1 2021-01-28T04:04:36.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-28T04:04:36.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Compile date Jan 27 2021 2021-01-28T04:04:36.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: DB SUMMARY 2021-01-28T04:04:36.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: CURRENT file: CURRENT 2021-01-28T04:04:36.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-28T04:04:36.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2021-01-28T04:04:36.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000004.sst 2021-01-28T04:04:36.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000006.log size: 74759 ; 2021-01-28T04:04:36.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.error_if_exists: 0 2021-01-28T04:04:36.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.create_if_missing: 0 2021-01-28T04:04:36.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.paranoid_checks: 1 2021-01-28T04:04:36.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.env: 0x55e241b611c0 2021-01-28T04:04:36.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.fs: Posix File System 2021-01-28T04:04:36.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.info_log: 0x55e243be9e80 2021-01-28T04:04:36.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-28T04:04:36.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.statistics: (nil) 2021-01-28T04:04:36.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.use_fsync: 0 2021-01-28T04:04:36.729 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_log_file_size: 0 2021-01-28T04:04:36.729 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-28T04:04:36.729 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-28T04:04:36.729 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-28T04:04:36.730 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-28T04:04:36.732 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.allow_fallocate: 1 2021-01-28T04:04:36.732 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-28T04:04:36.733 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-28T04:04:36.733 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.use_direct_reads: 0 2021-01-28T04:04:36.733 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-28T04:04:36.733 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-28T04:04:36.734 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.db_log_dir: 2021-01-28T04:04:36.734 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2021-01-28T04:04:36.735 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-28T04:04:36.735 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_subcompactions: 1 2021-01-28T04:04:36.735 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_background_flushes: -1 2021-01-28T04:04:36.735 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-28T04:04:36.736 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-28T04:04:36.736 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-28T04:04:36.736 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-28T04:04:36.737 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-28T04:04:36.737 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-28T04:04:36.737 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-28T04:04:36.737 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.write_buffer_manager: 0x55e243c43bf0 2021-01-28T04:04:36.738 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-28T04:04:36.738 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-28T04:04:36.738 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-28T04:04:36.739 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-28T04:04:36.739 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-28T04:04:36.739 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-28T04:04:36.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-28T04:04:36.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-28T04:04:36.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-28T04:04:36.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.unordered_write: 0 2021-01-28T04:04:36.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-28T04:04:36.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-28T04:04:36.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-28T04:04:36.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-28T04:04:36.742 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.row_cache: None 2021-01-28T04:04:36.742 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.wal_filter: None 2021-01-28T04:04:36.742 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-28T04:04:36.743 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-28T04:04:36.743 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.preserve_deletes: 0 2021-01-28T04:04:36.743 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.two_write_queues: 0 2021-01-28T04:04:36.743 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-28T04:04:36.744 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.atomic_flush: 0 2021-01-28T04:04:36.744 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-28T04:04:36.745 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-28T04:04:36.745 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-28T04:04:36.745 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.log_readahead_size: 0 2021-01-28T04:04:36.745 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-28T04:04:36.746 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_background_jobs: 2 2021-01-28T04:04:36.746 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_background_compactions: -1 2021-01-28T04:04:36.746 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-28T04:04:36.746 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-28T04:04:36.747 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-28T04:04:36.747 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-28T04:04:36.747 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-28T04:04:36.748 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-28T04:04:36.748 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-28T04:04:36.748 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-28T04:04:36.749 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_open_files: -1 2021-01-28T04:04:36.749 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-28T04:04:36.749 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-28T04:04:36.749 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-28T04:04:36.750 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-28T04:04:36.750 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Compression algorithms supported: 2021-01-28T04:04:36.750 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-28T04:04:36.751 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: kZSTD supported: 0 2021-01-28T04:04:36.752 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: kXpressCompression supported: 0 2021-01-28T04:04:36.753 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-28T04:04:36.754 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: kLZ4Compression supported: 1 2021-01-28T04:04:36.754 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: kBZip2Compression supported: 0 2021-01-28T04:04:36.754 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: kZlibCompression supported: 1 2021-01-28T04:04:36.754 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: kSnappyCompression supported: 1 2021-01-28T04:04:36.755 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-28T04:04:36.755 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 2021-01-28T04:04:36.755 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-28T04:04:36.756 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-28T04:04:36.756 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.merge_operator: 2021-01-28T04:04:36.756 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_filter: None 2021-01-28T04:04:36.756 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-28T04:04:36.756 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-28T04:04:36.757 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-28T04:04:36.757 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e243b921e0) 2021-01-28T04:04:36.757 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: cache_index_and_filter_blocks: 1 2021-01-28T04:04:36.757 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-28T04:04:36.758 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-28T04:04:36.758 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: pin_top_level_index_and_filter: 1 2021-01-28T04:04:36.758 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: index_type: 0 2021-01-28T04:04:36.758 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: data_block_index_type: 0 2021-01-28T04:04:36.758 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: index_shortening: 1 2021-01-28T04:04:36.759 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: data_block_hash_table_util_ratio: 0.750000 2021-01-28T04:04:36.759 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: hash_index_allow_collision: 1 2021-01-28T04:04:36.759 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: checksum: 1 2021-01-28T04:04:36.759 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: no_block_cache: 0 2021-01-28T04:04:36.760 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: block_cache: 0x55e243bca510 2021-01-28T04:04:36.760 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: block_cache_name: BinnedLRUCache 2021-01-28T04:04:36.760 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: block_cache_options: 2021-01-28T04:04:36.760 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: capacity : 536870912 2021-01-28T04:04:36.760 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: num_shard_bits : 4 2021-01-28T04:04:36.761 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: strict_capacity_limit : 0 2021-01-28T04:04:36.761 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: high_pri_pool_ratio: 0.000 2021-01-28T04:04:36.761 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: block_cache_compressed: (nil) 2021-01-28T04:04:36.761 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: persistent_cache: (nil) 2021-01-28T04:04:36.761 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: block_size: 4096 2021-01-28T04:04:36.762 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: block_size_deviation: 10 2021-01-28T04:04:36.762 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: block_restart_interval: 16 2021-01-28T04:04:36.762 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: index_block_restart_interval: 1 2021-01-28T04:04:36.762 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: metadata_block_size: 4096 2021-01-28T04:04:36.762 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: partition_filters: 0 2021-01-28T04:04:36.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: use_delta_encoding: 1 2021-01-28T04:04:36.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-28T04:04:36.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: whole_key_filtering: 1 2021-01-28T04:04:36.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: verify_compression: 0 2021-01-28T04:04:36.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: read_amp_bytes_per_bit: 0 2021-01-28T04:04:36.764 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: format_version: 2 2021-01-28T04:04:36.764 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: enable_index_compression: 1 2021-01-28T04:04:36.764 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: block_align: 0 2021-01-28T04:04:36.764 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-28T04:04:36.765 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-28T04:04:36.765 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compression: NoCompression 2021-01-28T04:04:36.765 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-28T04:04:36.765 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-28T04:04:36.765 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-28T04:04:36.766 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.num_levels: 7 2021-01-28T04:04:36.766 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-28T04:04:36.766 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-28T04:04:36.766 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-28T04:04:36.766 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-28T04:04:36.767 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-28T04:04:36.767 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-28T04:04:36.767 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-28T04:04:36.767 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-28T04:04:36.768 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-28T04:04:36.768 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-28T04:04:36.768 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-28T04:04:36.768 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-28T04:04:36.769 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-28T04:04:36.769 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-28T04:04:36.769 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-28T04:04:36.769 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-28T04:04:36.770 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-28T04:04:36.770 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-28T04:04:36.770 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-28T04:04:36.770 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-28T04:04:36.770 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-28T04:04:36.771 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-28T04:04:36.771 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-28T04:04:36.771 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-28T04:04:36.771 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-28T04:04:36.771 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-28T04:04:36.772 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-28T04:04:36.772 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-28T04:04:36.772 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-28T04:04:36.772 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-28T04:04:36.772 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-28T04:04:36.773 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-28T04:04:36.773 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-28T04:04:36.773 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-28T04:04:36.773 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-28T04:04:36.773 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-28T04:04:36.774 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-28T04:04:36.774 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-28T04:04:36.774 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-28T04:04:36.774 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-28T04:04:36.775 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-28T04:04:36.775 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-28T04:04:36.775 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-28T04:04:36.775 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-28T04:04:36.775 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-28T04:04:36.776 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-28T04:04:36.776 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-28T04:04:36.776 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.table_properties_collectors: 2021-01-28T04:04:36.776 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.inplace_update_support: 0 2021-01-28T04:04:36.777 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-28T04:04:36.777 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-28T04:04:36.777 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-28T04:04:36.777 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-28T04:04:36.777 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.bloom_locality: 0 2021-01-28T04:04:36.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.max_successive_merges: 0 2021-01-28T04:04:36.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-28T04:04:36.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-28T04:04:36.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-28T04:04:36.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-28T04:04:36.779 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.ttl: 2592000 2021-01-28T04:04:36.779 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.458+0000 7f9c425c6700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-28T04:04:36.779 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-28T04:04:36.779 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2021-01-28T04:04:36.780 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806676462904, "job": 1, "event": "recovery_started", "log_files": [6]} 2021-01-28T04:04:36.780 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2021-01-28T04:04:36.780 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-28T04:04:36.780 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806676463976, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 71015, "table_properties": {"data_size": 69283, "index_size": 337, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 581, "raw_key_size": 8981, "raw_average_key_size": 45, "raw_value_size": 64107, "raw_average_value_size": 327, "num_data_blocks": 11, "num_entries": 196, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611806676, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-28T04:04:36.780 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2021-01-28T04:04:36.781 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806676464554, "job": 1, "event": "recovery_finished"} 2021-01-28T04:04:36.781 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 4 rocksdb: DB pointer 0x55e243c89800 2021-01-28T04:04:36.781 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c293e7700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-28T04:04:36.781 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c293e7700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-28T04:04:36.781 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ** DB Stats ** 2021-01-28T04:04:36.782 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:04:36.782 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-28T04:04:36.782 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-28T04:04:36.782 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T04:04:36.783 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-28T04:04:36.783 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-28T04:04:36.783 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T04:04:36.783 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ** Compaction Stats [default] ** 2021-01-28T04:04:36.783 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:04:36.784 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:04:36.784 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: L0 2/0 71.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.1 0.00 0.00 1 0.001 0 0 2021-01-28T04:04:36.784 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Sum 2/0 71.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.1 0.00 0.00 1 0.001 0 0 2021-01-28T04:04:36.784 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.1 0.00 0.00 1 0.001 0 0 2021-01-28T04:04:36.785 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ** Compaction Stats [default] ** 2021-01-28T04:04:36.785 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:04:36.785 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:04:36.785 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 102.1 0.00 0.00 1 0.001 0 0 2021-01-28T04:04:36.785 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:04:36.786 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T04:04:36.786 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T04:04:36.786 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T04:04:36.786 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T04:04:36.786 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T04:04:36.787 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Cumulative compaction: 0.00 GB write, 11.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:04:36.787 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Interval compaction: 0.00 GB write, 11.88 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:04:36.787 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T04:04:36.787 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T04:04:36.787 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ** Compaction Stats [default] ** 2021-01-28T04:04:36.788 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:04:36.788 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:04:36.788 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: L0 2/0 71.00 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.1 0.00 0.00 1 0.001 0 0 2021-01-28T04:04:36.788 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Sum 2/0 71.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 102.1 0.00 0.00 1 0.001 0 0 2021-01-28T04:04:36.788 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T04:04:36.789 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ** Compaction Stats [default] ** 2021-01-28T04:04:36.789 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:04:36.789 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:04:36.789 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 102.1 0.00 0.00 1 0.001 0 0 2021-01-28T04:04:36.789 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:04:36.790 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T04:04:36.790 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T04:04:36.790 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T04:04:36.790 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T04:04:36.790 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T04:04:36.791 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Cumulative compaction: 0.00 GB write, 11.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:04:36.791 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:04:36.791 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T04:04:36.791 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T04:04:36.792 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.462+0000 7f9c425c6700 0 starting mon.a rank 0 at public addrs [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] at bind addrs [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:36.792 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 1 mon.a@-1(???) e1 preinit fsid d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:04:36.792 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 0 mon.a@-1(???).mds e1 new map 2021-01-28T04:04:36.792 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 0 mon.a@-1(???).mds e1 print_map 2021-01-28T04:04:36.792 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: e1 2021-01-28T04:04:36.793 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-28T04:04:36.793 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-28T04:04:36.793 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: legacy client fscid: -1 2021-01-28T04:04:36.793 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: 2021-01-28T04:04:36.794 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: No filesystems configured 2021-01-28T04:04:36.794 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 0 mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2021-01-28T04:04:36.794 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-28T04:04:36.794 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-28T04:04:36.794 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 0 mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2021-01-28T04:04:36.795 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: audit 2021-01-28T04:04:33.519718+0000 mon.a (mon.0) 10 : audit [DBG] from='client.? 172.21.15.150:0/2436247335' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:04:36.795 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 1 mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2021-01-28T04:04:36.795 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta expand map: {default=false} 2021-01-28T04:04:36.795 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta from 'false' to 'false' 2021-01-28T04:04:36.796 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta expanded map: {default=false} 2021-01-28T04:04:36.796 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta expand map: {default=info} 2021-01-28T04:04:36.796 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta from 'info' to 'info' 2021-01-28T04:04:36.797 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta expanded map: {default=info} 2021-01-28T04:04:36.797 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta expand map: {default=daemon} 2021-01-28T04:04:36.797 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-28T04:04:36.797 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-28T04:04:36.798 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta expand map: {default=debug} 2021-01-28T04:04:36.798 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-28T04:04:36.798 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: debug 2021-01-28T04:04:36.466+0000 7f9c425c6700 20 expand_channel_meta expanded map: {default=debug} 2021-01-28T04:04:36.798 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: cluster 2021-01-28T04:04:36.473494+0000 mon.a (mon.0) 1 : cluster [INF] mon.a is new leader, mons a in quorum (ranks 0) 2021-01-28T04:04:36.798 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: cluster 2021-01-28T04:04:36.473614+0000 mon.a (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {a=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0]} 2021-01-28T04:04:36.799 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: cluster 2021-01-28T04:04:36.473683+0000 mon.a (mon.0) 3 : cluster [DBG] fsmap 2021-01-28T04:04:36.799 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: cluster 2021-01-28T04:04:36.473744+0000 mon.a (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2021-01-28T04:04:36.799 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:36 smithi150 bash[9867]: cluster 2021-01-28T04:04:36.474366+0000 mon.a (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2021-01-28T04:04:37.384 INFO:teuthology.orchestra.run.smithi150.stderr:Wrote config to /etc/ceph/ceph.conf 2021-01-28T04:04:37.384 INFO:teuthology.orchestra.run.smithi150.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2021-01-28T04:04:37.385 INFO:teuthology.orchestra.run.smithi150.stderr:Creating mgr... 2021-01-28T04:04:37.386 INFO:teuthology.orchestra.run.smithi150.stderr:Verifying port 9283 ... 2021-01-28T04:04:37.388 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl daemon-reload 2021-01-28T04:04:37.609 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl stop ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.y 2021-01-28T04:04:37.625 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl reset-failed ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.y 2021-01-28T04:04:37.629 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Failed to reset failed state of unit ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.y.service: Unit ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.y.service not loaded. 2021-01-28T04:04:37.630 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl enable ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.y 2021-01-28T04:04:37.634 INFO:teuthology.orchestra.run.smithi150.stderr:systemctl: Created symlink /etc/systemd/system/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c.target.wants/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.y.service -> /etc/systemd/system/ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@.service. 2021-01-28T04:04:37.846 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: systemctl start ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.y 2021-01-28T04:04:37.861 INFO:teuthology.orchestra.run.smithi150.stderr:firewalld does not appear to be present 2021-01-28T04:04:37.862 INFO:teuthology.orchestra.run.smithi150.stderr:Not possible to enable service . firewalld.service is not available 2021-01-28T04:04:37.862 INFO:teuthology.orchestra.run.smithi150.stderr:Not possible to open ports <[]>. firewalld.service is not available 2021-01-28T04:04:37.863 INFO:teuthology.orchestra.run.smithi150.stderr:firewalld does not appear to be present 2021-01-28T04:04:37.864 INFO:teuthology.orchestra.run.smithi150.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2021-01-28T04:04:37.864 INFO:teuthology.orchestra.run.smithi150.stderr:Waiting for mgr to start... 2021-01-28T04:04:37.866 INFO:teuthology.orchestra.run.smithi150.stderr:Waiting for mgr... 2021-01-28T04:04:37.867 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-28T04:04:38.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:37 smithi150 bash[9867]: audit 2021-01-28T04:04:36.728265+0000 mon.a (mon.0) 6 : audit [INF] from='client.? 172.21.15.150:0/1914908029' entity='client.admin' 2021-01-28T04:04:39.600 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:39.600 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: { 2021-01-28T04:04:39.601 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "fsid": "d0bb049a-611d-11eb-8f9e-001a4aab830c", 2021-01-28T04:04:39.601 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "health": { 2021-01-28T04:04:39.602 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-28T04:04:39.603 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "checks": {}, 2021-01-28T04:04:39.603 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "mutes": [] 2021-01-28T04:04:39.603 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:39.603 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-28T04:04:39.604 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum": [ 2021-01-28T04:04:39.604 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 0 2021-01-28T04:04:39.604 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:39.604 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-28T04:04:39.604 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "a" 2021-01-28T04:04:39.605 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:39.605 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum_age": 3, 2021-01-28T04:04:39.605 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "monmap": { 2021-01-28T04:04:39.605 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:39.605 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-28T04:04:39.606 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-28T04:04:39.607 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:39.607 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osdmap": { 2021-01-28T04:04:39.608 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:39.608 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-28T04:04:39.608 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-28T04:04:39.608 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-28T04:04:39.609 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-28T04:04:39.609 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-28T04:04:39.609 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-28T04:04:39.609 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "pgmap": { 2021-01-28T04:04:39.612 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-28T04:04:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-28T04:04:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-28T04:04:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-28T04:04:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-28T04:04:39.613 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-28T04:04:39.614 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-28T04:04:39.614 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-28T04:04:39.614 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:39.614 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "fsmap": { 2021-01-28T04:04:39.614 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:39.615 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-28T04:04:39.615 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-28T04:04:39.615 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:39.615 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-28T04:04:39.615 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "available": false, 2021-01-28T04:04:39.616 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-28T04:04:39.616 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "modules": [ 2021-01-28T04:04:39.616 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "iostat", 2021-01-28T04:04:39.616 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "restful" 2021-01-28T04:04:39.617 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:39.617 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "services": {} 2021-01-28T04:04:39.617 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:39.617 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "servicemap": { 2021-01-28T04:04:39.618 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:39.618 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "modified": "2021-01-28T04:04:23.621090+0000", 2021-01-28T04:04:39.618 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "services": {} 2021-01-28T04:04:39.619 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:39.619 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-28T04:04:39.619 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: } 2021-01-28T04:04:39.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:39 smithi150 bash[9867]: audit 2021-01-28T04:04:39.603424+0000 mon.a (mon.0) 7 : audit [DBG] from='client.? 172.21.15.150:0/2271604752' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-28T04:04:40.337 INFO:teuthology.orchestra.run.smithi150.stderr:mgr not available, waiting (1/15)... 2021-01-28T04:04:42.340 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-28T04:04:43.652 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: { 2021-01-28T04:04:43.653 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "fsid": "d0bb049a-611d-11eb-8f9e-001a4aab830c", 2021-01-28T04:04:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "health": { 2021-01-28T04:04:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-28T04:04:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "checks": {}, 2021-01-28T04:04:43.654 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "mutes": [] 2021-01-28T04:04:43.656 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:43.657 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-28T04:04:43.657 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum": [ 2021-01-28T04:04:43.657 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 0 2021-01-28T04:04:43.658 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:43.658 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-28T04:04:43.658 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "a" 2021-01-28T04:04:43.658 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:43.659 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum_age": 7, 2021-01-28T04:04:43.659 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "monmap": { 2021-01-28T04:04:43.659 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:43.659 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-28T04:04:43.659 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-28T04:04:43.660 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:43.660 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osdmap": { 2021-01-28T04:04:43.660 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:43.661 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-28T04:04:43.661 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-28T04:04:43.661 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-28T04:04:43.665 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-28T04:04:43.665 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-28T04:04:43.665 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-28T04:04:43.666 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:43.666 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "pgmap": { 2021-01-28T04:04:43.667 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-28T04:04:43.668 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-28T04:04:43.668 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-28T04:04:43.669 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-28T04:04:43.669 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-28T04:04:43.669 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-28T04:04:43.670 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-28T04:04:43.670 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-28T04:04:43.670 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:43.670 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "fsmap": { 2021-01-28T04:04:43.670 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:43.671 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-28T04:04:43.671 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-28T04:04:43.671 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:43.671 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-28T04:04:43.672 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "available": false, 2021-01-28T04:04:43.672 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-28T04:04:43.672 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "modules": [ 2021-01-28T04:04:43.672 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "iostat", 2021-01-28T04:04:43.673 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "restful" 2021-01-28T04:04:43.673 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:43.673 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "services": {} 2021-01-28T04:04:43.673 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:43.674 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "servicemap": { 2021-01-28T04:04:43.674 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:43.674 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "modified": "2021-01-28T04:04:23.621090+0000", 2021-01-28T04:04:43.674 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "services": {} 2021-01-28T04:04:43.675 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:43.675 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-28T04:04:43.675 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: } 2021-01-28T04:04:43.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:43 smithi150 bash[9867]: audit 2021-01-28T04:04:43.655421+0000 mon.a (mon.0) 8 : audit [DBG] from='client.? 172.21.15.150:0/1071408792' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-28T04:04:44.299 INFO:teuthology.orchestra.run.smithi150.stderr:mgr not available, waiting (2/15)... 2021-01-28T04:04:45.471 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: cluster 2021-01-28T04:04:45.072771+0000 mon.a (mon.0) 9 : cluster [INF] Activating manager daemon y 2021-01-28T04:04:45.471 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: cluster 2021-01-28T04:04:45.078340+0000 mon.a (mon.0) 10 : cluster [DBG] mgrmap e2: y(active, starting, since 0.0057643s) 2021-01-28T04:04:45.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.080473+0000 mon.a (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-28T04:04:45.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.081069+0000 mon.a (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-28T04:04:45.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.081455+0000 mon.a (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-28T04:04:45.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.082396+0000 mon.a (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-28T04:04:45.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.083157+0000 mon.a (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-28T04:04:45.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: cluster 2021-01-28T04:04:45.088169+0000 mon.a (mon.0) 16 : cluster [INF] Manager daemon y is now available 2021-01-28T04:04:45.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.107979+0000 mon.a (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' 2021-01-28T04:04:45.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.108291+0000 mon.a (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:04:45.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.110610+0000 mon.a (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:04:45.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:45 smithi150 bash[9867]: audit 2021-01-28T04:04:45.122004+0000 mon.a (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' 2021-01-28T04:04:46.296 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 status -f json-pretty 2021-01-28T04:04:46.471 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:46 smithi150 bash[9867]: audit 2021-01-28T04:04:45.127199+0000 mon.a (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.150:0/1717290122' entity='mgr.y' 2021-01-28T04:04:46.471 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:46 smithi150 bash[9867]: cluster 2021-01-28T04:04:46.083436+0000 mon.a (mon.0) 22 : cluster [DBG] mgrmap e3: y(active, since 1.01085s) 2021-01-28T04:04:47.934 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 2021-01-28T04:04:47.934 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: { 2021-01-28T04:04:47.935 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "fsid": "d0bb049a-611d-11eb-8f9e-001a4aab830c", 2021-01-28T04:04:47.935 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "health": { 2021-01-28T04:04:47.937 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2021-01-28T04:04:47.937 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "checks": {}, 2021-01-28T04:04:47.937 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "mutes": [] 2021-01-28T04:04:47.937 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:47.938 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "election_epoch": 5, 2021-01-28T04:04:47.938 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum": [ 2021-01-28T04:04:47.938 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 0 2021-01-28T04:04:47.938 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:47.938 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum_names": [ 2021-01-28T04:04:47.939 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "a" 2021-01-28T04:04:47.939 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:47.939 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "quorum_age": 11, 2021-01-28T04:04:47.939 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "monmap": { 2021-01-28T04:04:47.939 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:47.940 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2021-01-28T04:04:47.940 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_mons": 1 2021-01-28T04:04:47.940 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:47.940 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osdmap": { 2021-01-28T04:04:47.940 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:47.943 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_osds": 0, 2021-01-28T04:04:47.944 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_up_osds": 0, 2021-01-28T04:04:47.944 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osd_up_since": 0, 2021-01-28T04:04:47.944 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_in_osds": 0, 2021-01-28T04:04:47.944 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "osd_in_since": 0, 2021-01-28T04:04:47.944 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2021-01-28T04:04:47.945 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:47.945 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "pgmap": { 2021-01-28T04:04:47.945 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "pgs_by_state": [], 2021-01-28T04:04:47.945 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_pgs": 0, 2021-01-28T04:04:47.945 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_pools": 0, 2021-01-28T04:04:47.946 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_objects": 0, 2021-01-28T04:04:47.946 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "data_bytes": 0, 2021-01-28T04:04:47.946 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_used": 0, 2021-01-28T04:04:47.946 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_avail": 0, 2021-01-28T04:04:47.947 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "bytes_total": 0 2021-01-28T04:04:47.947 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:47.947 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "fsmap": { 2021-01-28T04:04:47.947 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:47.947 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "by_rank": [], 2021-01-28T04:04:47.948 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "up:standby": 0 2021-01-28T04:04:47.948 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:47.948 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "mgrmap": { 2021-01-28T04:04:47.948 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "available": true, 2021-01-28T04:04:47.948 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_standbys": 0, 2021-01-28T04:04:47.949 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "modules": [ 2021-01-28T04:04:47.949 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "iostat", 2021-01-28T04:04:47.949 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "restful" 2021-01-28T04:04:47.949 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ], 2021-01-28T04:04:47.949 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "services": {} 2021-01-28T04:04:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "servicemap": { 2021-01-28T04:04:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 1, 2021-01-28T04:04:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "modified": "2021-01-28T04:04:23.621090+0000", 2021-01-28T04:04:47.950 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "services": {} 2021-01-28T04:04:47.951 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: }, 2021-01-28T04:04:47.951 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "progress_events": {} 2021-01-28T04:04:47.951 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: } 2021-01-28T04:04:48.584 INFO:teuthology.orchestra.run.smithi150.stderr:mgr is available 2021-01-28T04:04:48.584 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config-key set mgr/cephadm/ssh_user root 2021-01-28T04:04:48.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:48 smithi150 bash[9867]: cluster 2021-01-28T04:04:47.483502+0000 mon.a (mon.0) 23 : cluster [DBG] mgrmap e4: y(active, since 2s) 2021-01-28T04:04:48.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:48 smithi150 bash[9867]: audit 2021-01-28T04:04:47.937433+0000 mon.a (mon.0) 24 : audit [DBG] from='client.? 172.21.15.150:0/4259868583' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2021-01-28T04:04:50.247 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: set mgr/cephadm/ssh_user 2021-01-28T04:04:50.881 INFO:teuthology.orchestra.run.smithi150.stderr:Enabling cephadm module... 2021-01-28T04:04:50.881 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr module enable cephadm 2021-01-28T04:04:51.685 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:51 smithi150 bash[9867]: audit 2021-01-28T04:04:50.248093+0000 mon.a (mon.0) 25 : audit [INF] from='client.? 172.21.15.150:0/3384455469' entity='client.admin' 2021-01-28T04:04:52.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:52 smithi150 bash[9867]: audit 2021-01-28T04:04:52.291708+0000 mon.a (mon.0) 26 : audit [INF] from='client.? 172.21.15.150:0/3979443415' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2021-01-28T04:04:52.971 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:04:52 smithi150 bash[10146]: ignoring --setgroup ceph since I am not root 2021-01-28T04:04:53.163 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr stat 2021-01-28T04:04:53.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:53 smithi150 bash[9867]: audit 2021-01-28T04:04:52.484931+0000 mon.a (mon.0) 27 : audit [INF] from='client.? 172.21.15.150:0/3979443415' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2021-01-28T04:04:53.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:53 smithi150 bash[9867]: cluster 2021-01-28T04:04:52.485046+0000 mon.a (mon.0) 28 : cluster [DBG] mgrmap e5: y(active, since 7s) 2021-01-28T04:04:54.686 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: { 2021-01-28T04:04:54.687 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 5, 2021-01-28T04:04:54.687 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "available": true, 2021-01-28T04:04:54.687 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "active_name": "y", 2021-01-28T04:04:54.688 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_standby": 0 2021-01-28T04:04:54.688 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: } 2021-01-28T04:04:55.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:54 smithi150 bash[9867]: audit 2021-01-28T04:04:54.690393+0000 mon.a (mon.0) 29 : audit [DBG] from='client.? 172.21.15.150:0/2627390932' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-28T04:04:55.353 INFO:teuthology.orchestra.run.smithi150.stderr:Waiting for the mgr to restart... 2021-01-28T04:04:55.353 INFO:teuthology.orchestra.run.smithi150.stderr:Waiting for mgr epoch 5... 2021-01-28T04:04:55.353 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 tell mgr mgr_status 2021-01-28T04:04:58.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:58 smithi150 bash[9867]: cluster 2021-01-28T04:04:58.368137+0000 mon.a (mon.0) 30 : cluster [INF] Active manager daemon y restarted 2021-01-28T04:04:58.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:58 smithi150 bash[9867]: cluster 2021-01-28T04:04:58.369120+0000 mon.a (mon.0) 31 : cluster [INF] Activating manager daemon y 2021-01-28T04:04:58.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:58 smithi150 bash[9867]: cluster 2021-01-28T04:04:58.372896+0000 mon.a (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2021-01-28T04:04:59.445 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: { 2021-01-28T04:04:59.445 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2021-01-28T04:04:59.446 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "initialized": true 2021-01-28T04:04:59.446 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: } 2021-01-28T04:04:59.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: cluster 2021-01-28T04:04:58.425054+0000 mon.a (mon.0) 33 : cluster [DBG] mgrmap e6: y(active, starting, since 0.0560221s) 2021-01-28T04:04:59.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.432154+0000 mon.a (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-28T04:04:59.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.433337+0000 mon.a (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-28T04:04:59.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.433495+0000 mon.a (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-28T04:04:59.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.433673+0000 mon.a (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-28T04:04:59.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.434153+0000 mon.a (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-28T04:04:59.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.434961+0000 mon.a (mon.0) 39 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-28T04:04:59.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.435358+0000 mon.a (mon.0) 40 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-28T04:04:59.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.435724+0000 mon.a (mon.0) 41 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-28T04:04:59.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.436130+0000 mon.a (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-28T04:04:59.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: cluster 2021-01-28T04:04:58.439444+0000 mon.a (mon.0) 43 : cluster [INF] Manager daemon y is now available 2021-01-28T04:04:59.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.461564+0000 mon.a (mon.0) 44 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:04:59.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.466536+0000 mon.a (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:04:59.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.471319+0000 mon.a (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:04:59.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.608609+0000 mon.a (mon.0) 47 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:04:59.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.620745+0000 mon.a (mon.0) 48 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:04:59.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.627769+0000 mon.a (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:04:59.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:04:59 smithi150 bash[9867]: audit 2021-01-28T04:04:58.630066+0000 mon.a (mon.0) 50 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:05:00.200 INFO:teuthology.orchestra.run.smithi150.stderr:mgr epoch 5 is available 2021-01-28T04:05:00.201 INFO:teuthology.orchestra.run.smithi150.stderr:Setting orchestrator backend to cephadm... 2021-01-28T04:05:00.201 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 orch set backend cephadm 2021-01-28T04:05:00.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:00 smithi150 bash[9867]: audit 2021-01-28T04:04:59.433943+0000 mgr.y (mgr.14116) 1 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-28T04:05:00.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:00 smithi150 bash[9867]: cluster 2021-01-28T04:04:59.434913+0000 mon.a (mon.0) 51 : cluster [DBG] mgrmap e7: y(active, since 1.06588s) 2021-01-28T04:05:00.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:00 smithi150 bash[9867]: audit 2021-01-28T04:04:59.449343+0000 mgr.y (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-28T04:05:01.720 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:01 smithi150 bash[9867]: cluster 2021-01-28T04:05:00.446385+0000 mon.a (mon.0) 52 : cluster [DBG] mgrmap e8: y(active, since 2s) 2021-01-28T04:05:02.342 INFO:teuthology.orchestra.run.smithi150.stderr:Generating ssh key... 2021-01-28T04:05:02.342 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 cephadm generate-key 2021-01-28T04:05:02.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:02 smithi150 bash[9867]: audit 2021-01-28T04:05:01.666445+0000 mgr.y (mgr.14116) 3 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:05:02.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:02 smithi150 bash[9867]: audit 2021-01-28T04:05:01.671502+0000 mon.a (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:05:02.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:02 smithi150 bash[9867]: audit 2021-01-28T04:05:01.685240+0000 mon.a (mon.0) 54 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:05:04.472 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: Generating public/private rsa key pair. 2021-01-28T04:05:04.472 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: Your identification has been saved in /tmp/tmp0ugfan1z/key. 2021-01-28T04:05:04.472 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: Your public key has been saved in /tmp/tmp0ugfan1z/key.pub. 2021-01-28T04:05:04.473 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: The key fingerprint is: 2021-01-28T04:05:04.473 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: SHA256:c+vkhulNuqBBr7p2dw1YU23J3xalwqifebTNVmGRvJ8 ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:05:04.473 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: The key's randomart image is: 2021-01-28T04:05:04.473 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: +---[RSA 3072]----+ 2021-01-28T04:05:04.474 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | o ...+| 2021-01-28T04:05:04.474 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | .o= =.| 2021-01-28T04:05:04.474 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | ...o..+o| 2021-01-28T04:05:04.474 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | o. .o.+| 2021-01-28T04:05:04.474 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | . oS.. . .+| 2021-01-28T04:05:04.475 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | . .. .+ = + E.| 2021-01-28T04:05:04.475 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | . o =B o + | 2021-01-28T04:05:04.475 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | . .+..+Bo. . | 2021-01-28T04:05:04.476 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: | .o+o. o+o+ | 2021-01-28T04:05:04.476 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:04 smithi150 bash[10146]: +----[SHA256]-----+ 2021-01-28T04:05:04.940 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 cephadm get-pub-key 2021-01-28T04:05:05.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:05 smithi150 bash[9867]: audit 2021-01-28T04:05:03.922395+0000 mgr.y (mgr.14116) 4 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:05:05.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:05 smithi150 bash[9867]: cephadm 2021-01-28T04:05:03.922897+0000 mgr.y (mgr.14116) 5 : cephadm [INF] Generating ssh key... 2021-01-28T04:05:05.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:05 smithi150 bash[9867]: audit 2021-01-28T04:05:04.202059+0000 mon.a (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:05:05.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:05 smithi150 bash[9867]: audit 2021-01-28T04:05:04.205473+0000 mon.a (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:05:06.426 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCBV/dceQZBg1bWm79TSRnyqiPg2AV/UqwR7SAutcxITFjaOwHNb7nq1FTjVVM5w9QdeCVb/U7nIMe5hBn/QkmSXR5R7FMNtXFsC2+ms1n2+FgMMEaJbcnQp29j/xL5SZ+geeGv7t4ACwSPEqVBJvpyD5ONrIMMCE3yikj4VZBRft8t/DR1Nes3vUDdSP9P7AheYeGunVInhApYOAu81/nNf4ptqxTRw7KH8gsxrqhSZHFQSIiE7xTQMMmNx0neTdBvKEAj3jVXSAZOuSsf6aRDCgM74/jjRVNsNm5zViYMId3iKtwDscl4YQNtFmKT0d105ojqWkWFRsItZpibFIMKGm5tuwkuwjwZufZ8xsDds7W2EzSUdjVrL8XkLZJioGDGxQMDQ/YS4l4LHuvLQX8jhPrLP6QJ0F4VvU9d70K33q5LfjZzKRJtQtl9U05o/+GCQBC33n/FIxFoJTUIeb7roZZNuBkwEt3MpfR/W2ZjIE9IhQaIuUKeZyHhZKT2T0= ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:05:07.097 INFO:teuthology.orchestra.run.smithi150.stderr:Wrote public SSH key to to /home/ubuntu/cephtest/ceph.pub 2021-01-28T04:05:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:Adding key to root@localhost's authorized_keys... 2021-01-28T04:05:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:Adding host smithi150... 2021-01-28T04:05:07.098 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 orch host add smithi150 2021-01-28T04:05:07.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:07 smithi150 bash[9867]: audit 2021-01-28T04:05:06.427997+0000 mgr.y (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:05:09.223 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:08 smithi150 bash[10146]: Warning: Permanently added 'smithi150,172.21.15.150' (ECDSA) to the list of known hosts. 2021-01-28T04:05:09.486 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: Added host 'smithi150' 2021-01-28T04:05:10.279 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config set mgr mgr/dashboard/ssl_server_port 8443 2021-01-28T04:05:10.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:10 smithi150 bash[9867]: audit 2021-01-28T04:05:08.721313+0000 mgr.y (mgr.14116) 7 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi150", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:05:10.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:10 smithi150 bash[9867]: audit 2021-01-28T04:05:09.485132+0000 mon.a (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:05:10.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:10 smithi150 bash[9867]: cephadm 2021-01-28T04:05:09.485902+0000 mgr.y (mgr.14116) 8 : cephadm [INF] Added host smithi150 2021-01-28T04:05:10.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:10 smithi150 bash[9867]: audit 2021-01-28T04:05:09.901608+0000 mon.a (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:05:10.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:10 smithi150 bash[9867]: audit 2021-01-28T04:05:09.902813+0000 mon.a (mon.0) 59 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:05:11.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:11 smithi150 bash[9867]: audit 2021-01-28T04:05:10.738935+0000 mon.a (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' 2021-01-28T04:05:11.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:11 smithi150 bash[9867]: audit 2021-01-28T04:05:10.740097+0000 mon.a (mon.0) 61 : audit [DBG] from='mgr.14116 172.21.15.150:0/3141045581' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:05:13.219 INFO:teuthology.orchestra.run.smithi150.stderr:Enabling the dashboard module... 2021-01-28T04:05:13.220 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr module enable dashboard 2021-01-28T04:05:13.272 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:13 smithi150 bash[9867]: audit 2021-01-28T04:05:12.201272+0000 mon.a (mon.0) 62 : audit [INF] from='client.? 172.21.15.150:0/3322091891' entity='client.admin' 2021-01-28T04:05:15.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:14 smithi150 bash[9867]: audit 2021-01-28T04:05:14.794052+0000 mon.a (mon.0) 63 : audit [INF] from='client.? 172.21.15.150:0/2273690167' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2021-01-28T04:05:15.223 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:14 smithi150 bash[10146]: ignoring --setuser ceph since I am not root 2021-01-28T04:05:15.224 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:14 smithi150 bash[10146]: ignoring --setgroup ceph since I am not root 2021-01-28T04:05:15.552 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 mgr stat 2021-01-28T04:05:15.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:15 smithi150 bash[9867]: audit 2021-01-28T04:05:14.848421+0000 mon.a (mon.0) 64 : audit [INF] from='client.? 172.21.15.150:0/2273690167' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2021-01-28T04:05:15.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:15 smithi150 bash[9867]: cluster 2021-01-28T04:05:14.848517+0000 mon.a (mon.0) 65 : cluster [DBG] mgrmap e9: y(active, since 16s) 2021-01-28T04:05:17.114 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: { 2021-01-28T04:05:17.114 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "epoch": 9, 2021-01-28T04:05:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "available": true, 2021-01-28T04:05:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "active_name": "y", 2021-01-28T04:05:17.115 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "num_standby": 0 2021-01-28T04:05:17.116 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: } 2021-01-28T04:05:17.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:17 smithi150 bash[9867]: audit 2021-01-28T04:05:17.115631+0000 mon.a (mon.0) 66 : audit [DBG] from='client.? 172.21.15.150:0/120876609' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2021-01-28T04:05:17.724 INFO:teuthology.orchestra.run.smithi150.stderr:Waiting for the mgr to restart... 2021-01-28T04:05:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:Waiting for mgr epoch 9... 2021-01-28T04:05:17.725 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 tell mgr mgr_status 2021-01-28T04:05:21.223 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:05:20 smithi150 bash[10146]: Warning: Permanently added 'smithi150,172.21.15.150' (ECDSA) to the list of known hosts. 2021-01-28T04:05:21.769 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: { 2021-01-28T04:05:21.770 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2021-01-28T04:05:21.770 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: "initialized": true 2021-01-28T04:05:21.770 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: } 2021-01-28T04:05:21.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: cluster 2021-01-28T04:05:20.700559+0000 mon.a (mon.0) 67 : cluster [INF] Active manager daemon y restarted 2021-01-28T04:05:21.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: cluster 2021-01-28T04:05:20.701354+0000 mon.a (mon.0) 68 : cluster [INF] Activating manager daemon y 2021-01-28T04:05:21.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: cluster 2021-01-28T04:05:20.704733+0000 mon.a (mon.0) 69 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2021-01-28T04:05:21.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: cluster 2021-01-28T04:05:20.756565+0000 mon.a (mon.0) 70 : cluster [DBG] mgrmap e10: y(active, starting, since 0.0553831s) 2021-01-28T04:05:21.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.759886+0000 mon.a (mon.0) 71 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2021-01-28T04:05:21.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.761548+0000 mon.a (mon.0) 72 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2021-01-28T04:05:21.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.761912+0000 mon.a (mon.0) 73 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2021-01-28T04:05:21.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.762229+0000 mon.a (mon.0) 74 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2021-01-28T04:05:21.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.762893+0000 mon.a (mon.0) 75 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key ls"}]: dispatch 2021-01-28T04:05:21.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.764255+0000 mon.a (mon.0) 76 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/host.smithi150"}]: dispatch 2021-01-28T04:05:21.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.764741+0000 mon.a (mon.0) 77 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/inventory"}]: dispatch 2021-01-28T04:05:21.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.765224+0000 mon.a (mon.0) 78 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/osd_remove_queue"}]: dispatch 2021-01-28T04:05:21.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.765675+0000 mon.a (mon.0) 79 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_key"}]: dispatch 2021-01-28T04:05:21.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.766120+0000 mon.a (mon.0) 80 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_identity_pub"}]: dispatch 2021-01-28T04:05:21.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.766535+0000 mon.a (mon.0) 81 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/cephadm/ssh_user"}]: dispatch 2021-01-28T04:05:21.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.767012+0000 mon.a (mon.0) 82 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/devicehealth/last_scrape"}]: dispatch 2021-01-28T04:05:21.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.767439+0000 mon.a (mon.0) 83 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/report_id"}]: dispatch 2021-01-28T04:05:21.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.767861+0000 mon.a (mon.0) 84 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/telemetry/salt"}]: dispatch 2021-01-28T04:05:21.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: cluster 2021-01-28T04:05:20.771644+0000 mon.a (mon.0) 85 : cluster [INF] Manager daemon y is now available 2021-01-28T04:05:21.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.930651+0000 mon.a (mon.0) 86 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:05:21.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:20.934539+0000 mon.a (mon.0) 87 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:05:21.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:21 smithi150 bash[9867]: audit 2021-01-28T04:05:21.153388+0000 mon.a (mon.0) 88 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:05:22.920 INFO:teuthology.orchestra.run.smithi150.stderr:mgr epoch 9 is available 2021-01-28T04:05:22.921 INFO:teuthology.orchestra.run.smithi150.stderr:Generating a dashboard self-signed certificate... 2021-01-28T04:05:22.921 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 dashboard create-self-signed-cert 2021-01-28T04:05:23.020 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:22 smithi150 bash[9867]: audit 2021-01-28T04:05:21.760474+0000 mgr.y (mgr.14138) 1 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2021-01-28T04:05:23.021 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:22 smithi150 bash[9867]: cluster 2021-01-28T04:05:21.761007+0000 mon.a (mon.0) 89 : cluster [DBG] mgrmap e11: y(active, since 1.05983s) 2021-01-28T04:05:23.021 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:22 smithi150 bash[9867]: audit 2021-01-28T04:05:21.771775+0000 mgr.y (mgr.14138) 2 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2021-01-28T04:05:23.021 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:22 smithi150 bash[9867]: audit 2021-01-28T04:05:21.834878+0000 mon.a (mon.0) 90 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:23.021 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:22 smithi150 bash[9867]: audit 2021-01-28T04:05:21.835929+0000 mon.a (mon.0) 91 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:05:24.149 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:23 smithi150 bash[9867]: cluster 2021-01-28T04:05:22.839617+0000 mon.a (mon.0) 92 : cluster [DBG] mgrmap e12: y(active, since 2s) 2021-01-28T04:05:25.062 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: Self-signed certificate created 2021-01-28T04:05:25.664 INFO:teuthology.orchestra.run.smithi150.stderr:Creating initial admin user... 2021-01-28T04:05:25.665 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z -v /tmp/ceph-tmpg4b_mykn:/tmp/dashboard.pw:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 dashboard ac-user-create admin -i /tmp/dashboard.pw administrator --force-password --pwd-update-required 2021-01-28T04:05:26.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:26 smithi150 bash[9867]: audit 2021-01-28T04:05:24.963206+0000 mgr.y (mgr.14138) 3 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:05:26.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:26 smithi150 bash[9867]: audit 2021-01-28T04:05:25.060508+0000 mon.a (mon.0) 93 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:26.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:26 smithi150 bash[9867]: audit 2021-01-28T04:05:25.063609+0000 mon.a (mon.0) 94 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:27.520 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$jODwfKmKR8wKHam3LHOQHexu4KAm8bkSRTwWfUT95Yhi18ZdkTRl6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1611806727, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2021-01-28T04:05:28.239 INFO:teuthology.orchestra.run.smithi150.stderr:Fetching dashboard port number... 2021-01-28T04:05:28.239 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/docker run --rm --ipc=host --net=host --entrypoint /usr/bin/ceph -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 -e NODE_NAME=smithi150 -v /var/log/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c:/var/log/ceph:z -v /tmp/ceph-tmprc80984q:/etc/ceph/ceph.client.admin.keyring:z -v /tmp/ceph-tmp6gr0kbn2:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 config get mgr mgr/dashboard/ssl_server_port 2021-01-28T04:05:28.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:28 smithi150 bash[9867]: audit 2021-01-28T04:05:27.277996+0000 mgr.y (mgr.14138) 4 : audit [DBG] from='client.14150 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:05:28.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:28 smithi150 bash[9867]: cluster 2021-01-28T04:05:27.493953+0000 mon.a (mon.0) 95 : cluster [DBG] mgrmap e13: y(active, since 6s) 2021-01-28T04:05:28.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:28 smithi150 bash[9867]: audit 2021-01-28T04:05:27.522031+0000 mon.a (mon.0) 96 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:29.763 INFO:teuthology.orchestra.run.smithi150.stderr:/usr/bin/ceph: 8443 2021-01-28T04:05:30.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:29 smithi150 bash[9867]: audit 2021-01-28T04:05:29.764529+0000 mon.a (mon.0) 97 : audit [DBG] from='client.? 172.21.15.150:0/2127911096' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2021-01-28T04:05:30.452 INFO:teuthology.orchestra.run.smithi150.stderr:firewalld does not appear to be present 2021-01-28T04:05:30.452 INFO:teuthology.orchestra.run.smithi150.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2021-01-28T04:05:30.456 INFO:teuthology.orchestra.run.smithi150.stderr:Ceph Dashboard is now available at: 2021-01-28T04:05:30.457 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:05:30.457 INFO:teuthology.orchestra.run.smithi150.stderr: URL: https://smithi150.front.sepia.ceph.com:8443/ 2021-01-28T04:05:30.457 INFO:teuthology.orchestra.run.smithi150.stderr: User: admin 2021-01-28T04:05:30.457 INFO:teuthology.orchestra.run.smithi150.stderr: Password: lhrjzx9ptd 2021-01-28T04:05:30.457 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:05:30.458 INFO:teuthology.orchestra.run.smithi150.stderr:You can access the Ceph CLI with: 2021-01-28T04:05:30.458 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:05:30.458 INFO:teuthology.orchestra.run.smithi150.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2021-01-28T04:05:30.458 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:05:30.458 INFO:teuthology.orchestra.run.smithi150.stderr:Please consider enabling telemetry to help improve Ceph: 2021-01-28T04:05:30.459 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:05:30.459 INFO:teuthology.orchestra.run.smithi150.stderr: ceph telemetry on 2021-01-28T04:05:30.459 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:05:30.459 INFO:teuthology.orchestra.run.smithi150.stderr:For more information see: 2021-01-28T04:05:30.459 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:05:30.460 INFO:teuthology.orchestra.run.smithi150.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2021-01-28T04:05:30.460 INFO:teuthology.orchestra.run.smithi150.stderr: 2021-01-28T04:05:30.460 INFO:teuthology.orchestra.run.smithi150.stderr:Bootstrap complete. 2021-01-28T04:05:30.460 INFO:teuthology.orchestra.run.smithi150.stderr:Releasing lock 140209774267456 on /run/cephadm/d0bb049a-611d-11eb-8f9e-001a4aab830c.lock 2021-01-28T04:05:30.460 INFO:teuthology.orchestra.run.smithi150.stderr:Lock 140209774267456 released on /run/cephadm/d0bb049a-611d-11eb-8f9e-001a4aab830c.lock 2021-01-28T04:05:30.491 INFO:tasks.cephadm:Fetching config... 2021-01-28T04:05:30.492 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:05:30.492 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2021-01-28T04:05:30.498 INFO:tasks.cephadm:Fetching client.admin keyring... 2021-01-28T04:05:30.498 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:05:30.499 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2021-01-28T04:05:30.544 INFO:tasks.cephadm:Fetching mon keyring... 2021-01-28T04:05:30.544 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:05:30.545 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd if=/var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/keyring of=/dev/stdout 2021-01-28T04:05:30.555 INFO:tasks.cephadm:Fetching pub ssh key... 2021-01-28T04:05:30.556 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:05:30.556 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2021-01-28T04:05:30.562 INFO:tasks.cephadm:Installing pub ssh key for root users... 2021-01-28T04:05:30.562 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCBV/dceQZBg1bWm79TSRnyqiPg2AV/UqwR7SAutcxITFjaOwHNb7nq1FTjVVM5w9QdeCVb/U7nIMe5hBn/QkmSXR5R7FMNtXFsC2+ms1n2+FgMMEaJbcnQp29j/xL5SZ+geeGv7t4ACwSPEqVBJvpyD5ONrIMMCE3yikj4VZBRft8t/DR1Nes3vUDdSP9P7AheYeGunVInhApYOAu81/nNf4ptqxTRw7KH8gsxrqhSZHFQSIiE7xTQMMmNx0neTdBvKEAj3jVXSAZOuSsf6aRDCgM74/jjRVNsNm5zViYMId3iKtwDscl4YQNtFmKT0d105ojqWkWFRsItZpibFIMKGm5tuwkuwjwZufZ8xsDds7W2EzSUdjVrL8XkLZJioGDGxQMDQ/YS4l4LHuvLQX8jhPrLP6QJ0F4VvU9d70K33q5LfjZzKRJtQtl9U05o/+GCQBC33n/FIxFoJTUIeb7roZZNuBkwEt3MpfR/W2ZjIE9IhQaIuUKeZyHhZKT2T0= ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-28T04:05:30.590 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCBV/dceQZBg1bWm79TSRnyqiPg2AV/UqwR7SAutcxITFjaOwHNb7nq1FTjVVM5w9QdeCVb/U7nIMe5hBn/QkmSXR5R7FMNtXFsC2+ms1n2+FgMMEaJbcnQp29j/xL5SZ+geeGv7t4ACwSPEqVBJvpyD5ONrIMMCE3yikj4VZBRft8t/DR1Nes3vUDdSP9P7AheYeGunVInhApYOAu81/nNf4ptqxTRw7KH8gsxrqhSZHFQSIiE7xTQMMmNx0neTdBvKEAj3jVXSAZOuSsf6aRDCgM74/jjRVNsNm5zViYMId3iKtwDscl4YQNtFmKT0d105ojqWkWFRsItZpibFIMKGm5tuwkuwjwZufZ8xsDds7W2EzSUdjVrL8XkLZJioGDGxQMDQ/YS4l4LHuvLQX8jhPrLP6QJ0F4VvU9d70K33q5LfjZzKRJtQtl9U05o/+GCQBC33n/FIxFoJTUIeb7roZZNuBkwEt3MpfR/W2ZjIE9IhQaIuUKeZyHhZKT2T0= ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:05:30.602 DEBUG:teuthology.orchestra.run.smithi150:> sudo install -d -m 0700 /root/.ssh &&echo ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCBV/dceQZBg1bWm79TSRnyqiPg2AV/UqwR7SAutcxITFjaOwHNb7nq1FTjVVM5w9QdeCVb/U7nIMe5hBn/QkmSXR5R7FMNtXFsC2+ms1n2+FgMMEaJbcnQp29j/xL5SZ+geeGv7t4ACwSPEqVBJvpyD5ONrIMMCE3yikj4VZBRft8t/DR1Nes3vUDdSP9P7AheYeGunVInhApYOAu81/nNf4ptqxTRw7KH8gsxrqhSZHFQSIiE7xTQMMmNx0neTdBvKEAj3jVXSAZOuSsf6aRDCgM74/jjRVNsNm5zViYMId3iKtwDscl4YQNtFmKT0d105ojqWkWFRsItZpibFIMKGm5tuwkuwjwZufZ8xsDds7W2EzSUdjVrL8XkLZJioGDGxQMDQ/YS4l4LHuvLQX8jhPrLP6QJ0F4VvU9d70K33q5LfjZzKRJtQtl9U05o/+GCQBC33n/FIxFoJTUIeb7roZZNuBkwEt3MpfR/W2ZjIE9IhQaIuUKeZyHhZKT2T0= ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c |sudo tee -a /root/.ssh/authorized_keys &&sudo chmod 0600 /root/.ssh/authorized_keys 2021-01-28T04:05:30.627 INFO:teuthology.orchestra.run.smithi150.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDCBV/dceQZBg1bWm79TSRnyqiPg2AV/UqwR7SAutcxITFjaOwHNb7nq1FTjVVM5w9QdeCVb/U7nIMe5hBn/QkmSXR5R7FMNtXFsC2+ms1n2+FgMMEaJbcnQp29j/xL5SZ+geeGv7t4ACwSPEqVBJvpyD5ONrIMMCE3yikj4VZBRft8t/DR1Nes3vUDdSP9P7AheYeGunVInhApYOAu81/nNf4ptqxTRw7KH8gsxrqhSZHFQSIiE7xTQMMmNx0neTdBvKEAj3jVXSAZOuSsf6aRDCgM74/jjRVNsNm5zViYMId3iKtwDscl4YQNtFmKT0d105ojqWkWFRsItZpibFIMKGm5tuwkuwjwZufZ8xsDds7W2EzSUdjVrL8XkLZJioGDGxQMDQ/YS4l4LHuvLQX8jhPrLP6QJ0F4VvU9d70K33q5LfjZzKRJtQtl9U05o/+GCQBC33n/FIxFoJTUIeb7roZZNuBkwEt3MpfR/W2ZjIE9IhQaIuUKeZyHhZKT2T0= ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:05:30.639 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph config set mgr mgr/cephadm/allow_ptrace true 2021-01-28T04:05:35.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:34 smithi150 bash[9867]: audit 2021-01-28T04:05:34.881041+0000 mon.a (mon.0) 98 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:05:36.178 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2021-01-28T04:05:36.178 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:05:36.179 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2021-01-28T04:05:36.187 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:05:36.188 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-28T04:05:36.236 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2021-01-28T04:05:36.237 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch host add smithi134 2021-01-28T04:05:36.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: audit 2021-01-28T04:05:35.231551+0000 mon.a (mon.0) 99 : audit [INF] from='client.? 172.21.15.150:0/203979650' entity='client.admin' 2021-01-28T04:05:36.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: audit 2021-01-28T04:05:35.242699+0000 mon.a (mon.0) 100 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:36.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: cephadm 2021-01-28T04:05:35.243365+0000 mgr.y (mgr.14138) 5 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:05:36.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: audit 2021-01-28T04:05:35.739321+0000 mon.a (mon.0) 101 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:36.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: cephadm 2021-01-28T04:05:35.739908+0000 mgr.y (mgr.14138) 6 : cephadm [INF] Reconfiguring mon.a (unknown last config time)... 2021-01-28T04:05:36.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: audit 2021-01-28T04:05:35.740327+0000 mon.a (mon.0) 102 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:05:36.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: audit 2021-01-28T04:05:35.741390+0000 mon.a (mon.0) 103 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:05:36.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: cephadm 2021-01-28T04:05:35.742391+0000 mgr.y (mgr.14138) 7 : cephadm [INF] Reconfiguring daemon mon.a on smithi150 2021-01-28T04:05:36.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:36 smithi150 bash[9867]: audit 2021-01-28T04:05:35.743218+0000 mon.a (mon.0) 104 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T04:05:42.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:41 smithi150 bash[9867]: cluster 2021-01-28T04:05:40.763072+0000 mgr.y (mgr.14138) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:05:42.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:41 smithi150 bash[9867]: audit 2021-01-28T04:05:40.859306+0000 mon.a (mon.0) 105 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:42.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:41 smithi150 bash[9867]: cephadm 2021-01-28T04:05:40.860356+0000 mgr.y (mgr.14138) 9 : cephadm [INF] Reconfiguring mgr.y (unknown last config time)... 2021-01-28T04:05:42.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:41 smithi150 bash[9867]: audit 2021-01-28T04:05:40.860907+0000 mon.a (mon.0) 106 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-28T04:05:42.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:41 smithi150 bash[9867]: audit 2021-01-28T04:05:40.862464+0000 mon.a (mon.0) 107 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:05:42.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:41 smithi150 bash[9867]: cephadm 2021-01-28T04:05:40.863889+0000 mgr.y (mgr.14138) 10 : cephadm [INF] Reconfiguring daemon mgr.y on smithi150 2021-01-28T04:05:42.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:41 smithi150 bash[9867]: audit 2021-01-28T04:05:40.864919+0000 mon.a (mon.0) 108 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-28T04:05:44.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:43 smithi150 bash[9867]: cluster 2021-01-28T04:05:42.763488+0000 mgr.y (mgr.14138) 11 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:05:44.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:43 smithi150 bash[9867]: audit 2021-01-28T04:05:43.163869+0000 mon.a (mon.0) 109 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:44.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:43 smithi150 bash[9867]: audit 2021-01-28T04:05:43.167850+0000 mon.a (mon.0) 110 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:05:45.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:44 smithi150 bash[9867]: audit 2021-01-28T04:05:43.890623+0000 mon.a (mon.0) 111 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:45.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:44 smithi150 bash[9867]: audit 2021-01-28T04:05:43.896043+0000 mon.a (mon.0) 112 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:05:46.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:45 smithi150 bash[9867]: cluster 2021-01-28T04:05:44.763924+0000 mgr.y (mgr.14138) 12 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:05:47.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:47 smithi150 bash[9867]: cluster 2021-01-28T04:05:46.764398+0000 mgr.y (mgr.14138) 13 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:05:50.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:49 smithi150 bash[9867]: cluster 2021-01-28T04:05:48.764831+0000 mgr.y (mgr.14138) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:05:52.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:51 smithi150 bash[9867]: cluster 2021-01-28T04:05:50.765260+0000 mgr.y (mgr.14138) 15 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:05:54.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:53 smithi150 bash[9867]: cluster 2021-01-28T04:05:52.765675+0000 mgr.y (mgr.14138) 16 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:05:56.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:55 smithi150 bash[9867]: cluster 2021-01-28T04:05:54.766102+0000 mgr.y (mgr.14138) 17 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:05:57.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:57 smithi150 bash[9867]: cluster 2021-01-28T04:05:56.766490+0000 mgr.y (mgr.14138) 18 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:00.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:05:59 smithi150 bash[9867]: cluster 2021-01-28T04:05:58.766907+0000 mgr.y (mgr.14138) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:02.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:01 smithi150 bash[9867]: cluster 2021-01-28T04:06:00.767319+0000 mgr.y (mgr.14138) 20 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:03.472 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:06:03 smithi150 bash[10146]: Warning: Permanently added 'smithi134,172.21.15.134' (ECDSA) to the list of known hosts. 2021-01-28T04:06:03.883 INFO:teuthology.orchestra.run.smithi134.stdout:Added host 'smithi134' 2021-01-28T04:06:04.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:03 smithi150 bash[9867]: cluster 2021-01-28T04:06:02.767733+0000 mgr.y (mgr.14138) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:04.711 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch host ls --format=json 2021-01-28T04:06:05.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: audit 2021-01-28T04:06:03.097984+0000 mgr.y (mgr.14138) 22 : audit [DBG] from='client.14156 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:06:05.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: audit 2021-01-28T04:06:03.882985+0000 mon.a (mon.0) 113 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:05.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: cephadm 2021-01-28T04:06:03.883972+0000 mgr.y (mgr.14138) 23 : cephadm [INF] Added host smithi134 2021-01-28T04:06:05.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: audit 2021-01-28T04:06:03.888138+0000 mon.a (mon.0) 114 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:05.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: audit 2021-01-28T04:06:04.313769+0000 mon.a (mon.0) 115 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:05.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: audit 2021-01-28T04:06:04.315303+0000 mon.a (mon.0) 116 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:05.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: audit 2021-01-28T04:06:04.617342+0000 mon.a (mon.0) 117 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:05.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: audit 2021-01-28T04:06:04.631723+0000 mon.a (mon.0) 118 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:05.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:04 smithi150 bash[9867]: audit 2021-01-28T04:06:04.633010+0000 mon.a (mon.0) 119 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:06:06.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:05 smithi150 bash[9867]: cluster 2021-01-28T04:06:04.768216+0000 mgr.y (mgr.14138) 24 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:07.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:07 smithi150 bash[9867]: cluster 2021-01-28T04:06:06.768649+0000 mgr.y (mgr.14138) 25 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:09.567 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-01-28T04:06:09.568 INFO:teuthology.orchestra.run.smithi134.stdout:[{"addr": "smithi150", "hostname": "smithi150", "labels": [], "status": ""}, {"addr": "smithi134", "hostname": "smithi134", "labels": [], "status": ""}] 2021-01-28T04:06:10.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:09 smithi150 bash[9867]: cluster 2021-01-28T04:06:08.769045+0000 mgr.y (mgr.14138) 26 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:10.278 INFO:tasks.cephadm:Setting crush tunables to default 2021-01-28T04:06:10.281 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd crush tunables default 2021-01-28T04:06:11.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:10 smithi150 bash[9867]: audit 2021-01-28T04:06:09.568997+0000 mgr.y (mgr.14138) 27 : audit [DBG] from='client.14158 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T04:06:11.892 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:11 smithi150 bash[9867]: cluster 2021-01-28T04:06:10.769459+0000 mgr.y (mgr.14138) 28 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:11.892 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:11 smithi150 bash[9867]: audit 2021-01-28T04:06:11.274684+0000 mon.a (mon.0) 120 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:11.892 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:11 smithi150 bash[9867]: audit 2021-01-28T04:06:11.637148+0000 mon.a (mon.0) 121 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:13.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:12 smithi150 bash[9867]: cephadm 2021-01-28T04:06:11.637918+0000 mgr.y (mgr.14138) 29 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:06:13.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:12 smithi150 bash[9867]: audit 2021-01-28T04:06:12.070452+0000 mon.a (mon.0) 122 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:13.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:12 smithi150 bash[9867]: audit 2021-01-28T04:06:12.075914+0000 mon.a (mon.0) 123 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:14.083 INFO:teuthology.orchestra.run.smithi150.stderr:adjusted tunables profile to default 2021-01-28T04:06:14.149 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:13 smithi150 bash[9867]: cluster 2021-01-28T04:06:12.769937+0000 mgr.y (mgr.14138) 30 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:14.149 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:13 smithi150 bash[9867]: audit 2021-01-28T04:06:13.771836+0000 mon.a (mon.0) 124 : audit [INF] from='client.? 172.21.15.150:0/1279071561' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2021-01-28T04:06:14.871 INFO:tasks.cephadm:Adding mon.c on smithi150 2021-01-28T04:06:14.874 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add mon 'smithi150:[v2:172.21.15.150:3301,v1:172.21.15.150:6790]=c' 2021-01-28T04:06:15.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:15 smithi150 bash[9867]: audit 2021-01-28T04:06:14.079624+0000 mon.a (mon.0) 125 : audit [INF] from='client.? 172.21.15.150:0/1279071561' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2021-01-28T04:06:15.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:15 smithi150 bash[9867]: cluster 2021-01-28T04:06:14.079758+0000 mon.a (mon.0) 126 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2021-01-28T04:06:15.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:15 smithi150 bash[9867]: audit 2021-01-28T04:06:14.080350+0000 mon.a (mon.0) 127 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]: dispatch 2021-01-28T04:06:15.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:15 smithi150 bash[9867]: cluster 2021-01-28T04:06:14.770385+0000 mgr.y (mgr.14138) 31 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:16.382 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:16 smithi150 bash[9867]: audit 2021-01-28T04:06:15.083618+0000 mon.a (mon.0) 128 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1}]': finished 2021-01-28T04:06:16.382 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:16 smithi150 bash[9867]: cluster 2021-01-28T04:06:15.083706+0000 mon.a (mon.0) 129 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2021-01-28T04:06:16.383 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:16 smithi150 bash[9867]: audit 2021-01-28T04:06:15.085277+0000 mon.a (mon.0) 130 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2021-01-28T04:06:17.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:17 smithi150 bash[9867]: audit 2021-01-28T04:06:16.087763+0000 mon.a (mon.0) 131 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2021-01-28T04:06:17.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:17 smithi150 bash[9867]: cluster 2021-01-28T04:06:16.087890+0000 mon.a (mon.0) 132 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T04:06:17.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:17 smithi150 bash[9867]: cluster 2021-01-28T04:06:16.770977+0000 mgr.y (mgr.14138) 32 : cluster [DBG] pgmap v24: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:18.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:18 smithi150 bash[9867]: audit 2021-01-28T04:06:18.226206+0000 mon.a (mon.0) 133 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:18.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:18 smithi150 bash[9867]: audit 2021-01-28T04:06:18.227916+0000 mon.a (mon.0) 134 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:18.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:18 smithi150 bash[9867]: audit 2021-01-28T04:06:18.229998+0000 mon.a (mon.0) 135 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-28T04:06:19.766 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:19 smithi150 bash[9867]: audit 2021-01-28T04:06:18.221836+0000 mgr.y (mgr.14138) 33 : audit [DBG] from='client.14162 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi150:[v2:172.21.15.150:3301,v1:172.21.15.150:6790]=c", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:06:19.767 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:19 smithi150 bash[9867]: cephadm 2021-01-28T04:06:18.229196+0000 mgr.y (mgr.14138) 34 : cephadm [INF] Deploying daemon mon.c on smithi150 2021-01-28T04:06:19.767 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:19 smithi150 bash[9867]: cluster 2021-01-28T04:06:18.771528+0000 mgr.y (mgr.14138) 35 : cluster [DBG] pgmap v25: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:22.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:21 smithi150 bash[9867]: cluster 2021-01-28T04:06:20.771991+0000 mgr.y (mgr.14138) 36 : cluster [DBG] pgmap v26: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:22.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:21 smithi150 bash[9867]: audit 2021-01-28T04:06:20.934068+0000 mon.a (mon.0) 136 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:06:22.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:21 smithi150 bash[9867]: audit 2021-01-28T04:06:20.943228+0000 mon.a (mon.0) 137 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:06:22.826 INFO:teuthology.orchestra.run.smithi150.stdout:Deployed mon.c on host 'smithi150' 2021-01-28T04:06:24.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:23 smithi150 bash[9867]: cluster 2021-01-28T04:06:22.772373+0000 mgr.y (mgr.14138) 37 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:24.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:23 smithi150 bash[9867]: audit 2021-01-28T04:06:22.825079+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:24.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:23 smithi150 bash[9867]: audit 2021-01-28T04:06:22.827647+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:24.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:23 smithi150 bash[9867]: audit 2021-01-28T04:06:23.672817+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:24.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:23 smithi150 bash[9867]: audit 2021-01-28T04:06:23.677068+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:24.257 DEBUG:teuthology.orchestra.run.smithi150:mon.c> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.c.service 2021-01-28T04:06:24.261 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2021-01-28T04:06:24.261 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph mon dump -f json 2021-01-28T04:06:24.308 INFO:journalctl@ceph.mon.c.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:06:24.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.515+0000 7fdcee423700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-28T04:06:24.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.515+0000 7fdcee423700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-28T04:06:24.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.515+0000 7fdcee423700 0 pidfile_write: ignore empty --pid-file 2021-01-28T04:06:24.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 0 load: jerasure load: lrc load: isa 2021-01-28T04:06:24.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: RocksDB version: 6.8.1 2021-01-28T04:06:24.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-28T04:06:24.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Compile date Jan 27 2021 2021-01-28T04:06:24.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: DB SUMMARY 2021-01-28T04:06:24.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: CURRENT file: CURRENT 2021-01-28T04:06:24.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-28T04:06:24.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-28T04:06:24.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2021-01-28T04:06:24.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000003.log size: 511 ; 2021-01-28T04:06:24.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.error_if_exists: 0 2021-01-28T04:06:24.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.create_if_missing: 0 2021-01-28T04:06:24.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.paranoid_checks: 1 2021-01-28T04:06:24.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.env: 0x559deecdd1c0 2021-01-28T04:06:24.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.fs: Posix File System 2021-01-28T04:06:24.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.info_log: 0x559df1501e80 2021-01-28T04:06:24.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-28T04:06:24.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.statistics: (nil) 2021-01-28T04:06:24.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.use_fsync: 0 2021-01-28T04:06:24.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_log_file_size: 0 2021-01-28T04:06:24.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-28T04:06:24.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-28T04:06:24.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-28T04:06:24.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-28T04:06:24.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.allow_fallocate: 1 2021-01-28T04:06:24.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-28T04:06:24.730 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-28T04:06:24.730 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.use_direct_reads: 0 2021-01-28T04:06:24.730 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-28T04:06:24.730 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-28T04:06:24.731 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.db_log_dir: 2021-01-28T04:06:24.731 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-c/store.db 2021-01-28T04:06:24.731 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-28T04:06:24.731 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_subcompactions: 1 2021-01-28T04:06:24.731 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_background_flushes: -1 2021-01-28T04:06:24.732 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-28T04:06:24.732 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-28T04:06:24.732 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-28T04:06:24.732 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-28T04:06:24.732 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-28T04:06:24.733 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-28T04:06:24.733 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-28T04:06:24.733 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.write_buffer_manager: 0x559df155bc20 2021-01-28T04:06:24.733 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-28T04:06:24.733 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-28T04:06:24.734 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-28T04:06:24.734 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-28T04:06:24.734 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-28T04:06:24.734 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-28T04:06:24.734 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-28T04:06:24.735 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-28T04:06:24.735 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-28T04:06:24.735 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.unordered_write: 0 2021-01-28T04:06:24.735 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-28T04:06:24.735 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-28T04:06:24.736 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-28T04:06:24.736 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-28T04:06:24.736 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.row_cache: None 2021-01-28T04:06:24.736 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.wal_filter: None 2021-01-28T04:06:24.736 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-28T04:06:24.736 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-28T04:06:24.737 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.preserve_deletes: 0 2021-01-28T04:06:24.737 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.two_write_queues: 0 2021-01-28T04:06:24.737 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-28T04:06:24.737 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.atomic_flush: 0 2021-01-28T04:06:24.737 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-28T04:06:24.738 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-28T04:06:24.738 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-28T04:06:24.738 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.log_readahead_size: 0 2021-01-28T04:06:24.738 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-28T04:06:24.738 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_background_jobs: 2 2021-01-28T04:06:24.739 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_background_compactions: -1 2021-01-28T04:06:24.739 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-28T04:06:24.739 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-28T04:06:24.739 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-28T04:06:24.739 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-28T04:06:24.740 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-28T04:06:24.740 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-28T04:06:24.740 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-28T04:06:24.740 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-28T04:06:24.740 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_open_files: -1 2021-01-28T04:06:24.741 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-28T04:06:24.741 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-28T04:06:24.741 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-28T04:06:24.741 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-28T04:06:24.741 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Compression algorithms supported: 2021-01-28T04:06:24.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-28T04:06:24.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: kZSTD supported: 0 2021-01-28T04:06:24.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: kXpressCompression supported: 0 2021-01-28T04:06:24.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-28T04:06:24.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: kLZ4Compression supported: 1 2021-01-28T04:06:24.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: kBZip2Compression supported: 0 2021-01-28T04:06:24.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: kZlibCompression supported: 1 2021-01-28T04:06:24.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: kSnappyCompression supported: 1 2021-01-28T04:06:24.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-28T04:06:24.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 2021-01-28T04:06:24.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-28T04:06:24.744 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-28T04:06:24.744 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.merge_operator: 2021-01-28T04:06:24.744 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_filter: None 2021-01-28T04:06:24.744 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-28T04:06:24.744 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-28T04:06:24.745 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-28T04:06:24.745 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559df14aa1e0) 2021-01-28T04:06:24.745 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: cache_index_and_filter_blocks: 1 2021-01-28T04:06:24.745 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-28T04:06:24.745 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-28T04:06:24.746 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: pin_top_level_index_and_filter: 1 2021-01-28T04:06:24.746 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: index_type: 0 2021-01-28T04:06:24.746 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: data_block_index_type: 0 2021-01-28T04:06:24.746 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: index_shortening: 1 2021-01-28T04:06:24.746 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: data_block_hash_table_util_ratio: 0.750000 2021-01-28T04:06:24.747 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: hash_index_allow_collision: 1 2021-01-28T04:06:24.747 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: checksum: 1 2021-01-28T04:06:24.747 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: no_block_cache: 0 2021-01-28T04:06:24.747 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: block_cache: 0x559df14e2510 2021-01-28T04:06:24.747 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: block_cache_name: BinnedLRUCache 2021-01-28T04:06:24.748 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: block_cache_options: 2021-01-28T04:06:24.748 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: capacity : 536870912 2021-01-28T04:06:24.748 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: num_shard_bits : 4 2021-01-28T04:06:24.748 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: strict_capacity_limit : 0 2021-01-28T04:06:24.748 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: high_pri_pool_ratio: 0.000 2021-01-28T04:06:24.749 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: block_cache_compressed: (nil) 2021-01-28T04:06:24.749 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: persistent_cache: (nil) 2021-01-28T04:06:24.749 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: block_size: 4096 2021-01-28T04:06:24.749 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: block_size_deviation: 10 2021-01-28T04:06:24.749 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: block_restart_interval: 16 2021-01-28T04:06:24.749 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: index_block_restart_interval: 1 2021-01-28T04:06:24.750 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: metadata_block_size: 4096 2021-01-28T04:06:24.750 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: partition_filters: 0 2021-01-28T04:06:24.750 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: use_delta_encoding: 1 2021-01-28T04:06:24.750 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-28T04:06:24.750 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: whole_key_filtering: 1 2021-01-28T04:06:24.751 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: verify_compression: 0 2021-01-28T04:06:24.751 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: read_amp_bytes_per_bit: 0 2021-01-28T04:06:24.751 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: format_version: 2 2021-01-28T04:06:24.751 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: enable_index_compression: 1 2021-01-28T04:06:24.751 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: block_align: 0 2021-01-28T04:06:24.752 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-28T04:06:24.752 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-28T04:06:24.752 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compression: NoCompression 2021-01-28T04:06:24.752 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-28T04:06:24.752 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-28T04:06:24.753 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-28T04:06:24.753 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.num_levels: 7 2021-01-28T04:06:24.753 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-28T04:06:24.753 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-28T04:06:24.753 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-28T04:06:24.753 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-28T04:06:24.754 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-28T04:06:24.754 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-28T04:06:24.754 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-28T04:06:24.754 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-28T04:06:24.755 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-28T04:06:24.755 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-28T04:06:24.755 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-28T04:06:24.755 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-28T04:06:24.755 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-28T04:06:24.755 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-28T04:06:24.756 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-28T04:06:24.756 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-28T04:06:24.756 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-28T04:06:24.756 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-28T04:06:24.756 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-28T04:06:24.757 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-28T04:06:24.757 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-28T04:06:24.757 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-28T04:06:24.757 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-28T04:06:24.757 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-28T04:06:24.758 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-28T04:06:24.758 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-28T04:06:24.758 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-28T04:06:24.758 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-28T04:06:24.758 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-28T04:06:24.759 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-28T04:06:24.759 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-28T04:06:24.759 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-28T04:06:24.759 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-28T04:06:24.759 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-28T04:06:24.760 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-28T04:06:24.760 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-28T04:06:24.760 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-28T04:06:24.760 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-28T04:06:24.760 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-28T04:06:24.760 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-28T04:06:24.761 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-28T04:06:24.761 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-28T04:06:24.761 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-28T04:06:24.761 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-28T04:06:24.761 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-28T04:06:24.762 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-28T04:06:24.762 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-28T04:06:24.762 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.table_properties_collectors: 2021-01-28T04:06:24.762 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.inplace_update_support: 0 2021-01-28T04:06:24.762 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-28T04:06:24.763 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-28T04:06:24.763 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-28T04:06:24.763 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-28T04:06:24.763 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.bloom_locality: 0 2021-01-28T04:06:24.763 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.max_successive_merges: 0 2021-01-28T04:06:24.764 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-28T04:06:24.764 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-28T04:06:24.764 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-28T04:06:24.764 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-28T04:06:24.764 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.ttl: 2592000 2021-01-28T04:06:24.765 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.519+0000 7fdcee423700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-28T04:06:24.765 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.523+0000 7fdcee423700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-28T04:06:24.765 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.523+0000 7fdcee423700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-28T04:06:24.765 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.523+0000 7fdcee423700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806784529070, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-28T04:06:24.765 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.523+0000 7fdcee423700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-28T04:06:24.766 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.523+0000 7fdcee423700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-28T04:06:24.766 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.523+0000 7fdcee423700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806784529694, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611806784, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-28T04:06:24.766 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.523+0000 7fdcee423700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-28T04:06:24.766 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.523+0000 7fdcee423700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806784530186, "job": 1, "event": "recovery_finished"} 2021-01-28T04:06:24.766 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.527+0000 7fdcee423700 4 rocksdb: DB pointer 0x559df15a1800 2021-01-28T04:06:24.767 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.527+0000 7fdcd5244700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-28T04:06:24.767 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.527+0000 7fdcd5244700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-28T04:06:24.767 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ** DB Stats ** 2021-01-28T04:06:24.767 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:06:24.767 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-28T04:06:24.768 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-28T04:06:24.768 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T04:06:24.768 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-28T04:06:24.768 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-28T04:06:24.768 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T04:06:24.769 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ** Compaction Stats [default] ** 2021-01-28T04:06:24.769 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:06:24.769 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:06:24.769 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:24.769 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:24.770 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:24.770 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ** Compaction Stats [default] ** 2021-01-28T04:06:24.770 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:06:24.770 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:06:24.770 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:24.771 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:06:24.771 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T04:06:24.771 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T04:06:24.771 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T04:06:24.771 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T04:06:24.772 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T04:06:24.772 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:06:24.772 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Interval compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:06:24.772 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T04:06:24.772 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T04:06:24.772 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ** Compaction Stats [default] ** 2021-01-28T04:06:24.773 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:06:24.773 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:06:24.773 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:24.773 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:24.773 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T04:06:24.774 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ** Compaction Stats [default] ** 2021-01-28T04:06:24.774 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:06:24.774 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:06:24.774 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.5 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:24.774 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:06:24.775 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T04:06:24.775 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T04:06:24.775 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T04:06:24.775 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T04:06:24.775 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T04:06:24.776 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Cumulative compaction: 0.00 GB write, 0.23 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:06:24.776 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:06:24.776 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T04:06:24.776 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T04:06:24.776 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.527+0000 7fdcee423700 0 mon.c does not exist in monmap, will attempt to join an existing cluster 2021-01-28T04:06:24.777 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.527+0000 7fdcee423700 0 using public_addrv [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] 2021-01-28T04:06:24.777 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.527+0000 7fdcee423700 0 starting mon.c rank -1 at public addrs [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] at bind addrs [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:06:24.777 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.527+0000 7fdcee423700 1 mon.c@-1(???) e0 preinit fsid d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:06:24.777 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 0 mon.c@-1(synchronizing).mds e1 new map 2021-01-28T04:06:24.777 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 0 mon.c@-1(synchronizing).mds e1 print_map 2021-01-28T04:06:24.778 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: e1 2021-01-28T04:06:24.778 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-28T04:06:24.778 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-28T04:06:24.778 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: legacy client fscid: -1 2021-01-28T04:06:24.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: 2021-01-28T04:06:24.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: No filesystems configured 2021-01-28T04:06:24.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-28T04:06:24.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-28T04:06:24.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-28T04:06:24.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-28T04:06:24.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-28T04:06:24.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-28T04:06:24.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-28T04:06:24.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.547+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-28T04:06:24.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.551+0000 7fdcd7a49700 0 mon.c@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-28T04:06:24.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.551+0000 7fdcd7a49700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T04:06:24.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.551+0000 7fdcd7a49700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T04:06:24.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.551+0000 7fdcd7a49700 0 mon.c@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T04:06:24.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: cluster 2021-01-28T04:06:22.772373+0000 mgr.y (mgr.14138) 37 : cluster [DBG] pgmap v27: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:24.782 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: audit 2021-01-28T04:06:22.825079+0000 mon.a (mon.0) 138 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:24.782 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: audit 2021-01-28T04:06:22.827647+0000 mon.a (mon.0) 139 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:24.782 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: audit 2021-01-28T04:06:23.672817+0000 mon.a (mon.0) 140 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:24.782 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: audit 2021-01-28T04:06:23.677068+0000 mon.a (mon.0) 141 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:24.782 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:24 smithi150 bash[13629]: debug 2021-01-28T04:06:24.551+0000 7fdcd7a49700 1 mon.c@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2021-01-28T04:06:29.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:24.564360+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-28T04:06:29.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:24.772874+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:29.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: audit 2021-01-28T04:06:25.560608+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: audit 2021-01-28T04:06:26.561008+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:26.562859+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-28T04:06:29.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:26.773384+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:29.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: audit 2021-01-28T04:06:27.560958+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: audit 2021-01-28T04:06:28.561030+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:28.773909+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:29.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: audit 2021-01-28T04:06:29.560900+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:29.573607+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-28T04:06:29.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:29.585920+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],c=[v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0]} 2021-01-28T04:06:29.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:29.586010+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-28T04:06:29.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:29.586060+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T04:06:29.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:29.586543+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 68s) 2021-01-28T04:06:29.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[9867]: cluster 2021-01-28T04:06:29.595777+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-28T04:06:29.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:24.564360+0000 mon.a (mon.0) 143 : cluster [INF] mon.a calling monitor election 2021-01-28T04:06:29.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:24.772874+0000 mgr.y (mgr.14138) 38 : cluster [DBG] pgmap v28: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:29.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: audit 2021-01-28T04:06:25.560608+0000 mon.a (mon.0) 144 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: audit 2021-01-28T04:06:26.561008+0000 mon.a (mon.0) 145 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:26.562859+0000 mon.c (mon.1) 1 : cluster [INF] mon.c calling monitor election 2021-01-28T04:06:29.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:26.773384+0000 mgr.y (mgr.14138) 39 : cluster [DBG] pgmap v29: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:29.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: audit 2021-01-28T04:06:27.560958+0000 mon.a (mon.0) 146 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: audit 2021-01-28T04:06:28.561030+0000 mon.a (mon.0) 147 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:28.773909+0000 mgr.y (mgr.14138) 40 : cluster [DBG] pgmap v30: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:29.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: audit 2021-01-28T04:06:29.560900+0000 mon.a (mon.0) 148 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:29.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:29.573607+0000 mon.a (mon.0) 149 : cluster [INF] mon.a is new leader, mons a,c in quorum (ranks 0,1) 2021-01-28T04:06:29.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:29.585920+0000 mon.a (mon.0) 150 : cluster [DBG] monmap e2: 2 mons at {a=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],c=[v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0]} 2021-01-28T04:06:29.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:29.586010+0000 mon.a (mon.0) 151 : cluster [DBG] fsmap 2021-01-28T04:06:29.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:29.586060+0000 mon.a (mon.0) 152 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T04:06:29.979 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:29.586543+0000 mon.a (mon.0) 153 : cluster [DBG] mgrmap e13: y(active, since 68s) 2021-01-28T04:06:29.979 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:29 smithi150 bash[13629]: cluster 2021-01-28T04:06:29.595777+0000 mon.a (mon.0) 154 : cluster [INF] overall HEALTH_OK 2021-01-28T04:06:30.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:30 smithi150 bash[9867]: audit 2021-01-28T04:06:30.561246+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:30.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:30 smithi150 bash[13629]: audit 2021-01-28T04:06:30.561246+0000 mon.a (mon.0) 155 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2021-01-28T04:06:31.137 INFO:teuthology.orchestra.run.smithi150.stdout: 2021-01-28T04:06:31.137 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":2,"fsid":"d0bb049a-611d-11eb-8f9e-001a4aab830c","modified":"2021-01-28T04:06:24.560532Z","created":"2021-01-28T04:04:18.633601Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3301","nonce":0},{"type":"v1","addr":"172.21.15.150:6790","nonce":0}]},"addr":"172.21.15.150:6790/0","public_addr":"172.21.15.150:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2021-01-28T04:06:31.149 INFO:teuthology.orchestra.run.smithi150.stderr:dumped monmap epoch 2 2021-01-28T04:06:31.936 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:31 smithi150 bash[9867]: cluster 2021-01-28T04:06:30.774398+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:31.937 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:31 smithi150 bash[9867]: audit 2021-01-28T04:06:31.140010+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.15.150:0/175402490' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T04:06:31.937 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:31 smithi150 bash[13629]: cluster 2021-01-28T04:06:30.774398+0000 mgr.y (mgr.14138) 41 : cluster [DBG] pgmap v31: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:31.938 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:31 smithi150 bash[13629]: audit 2021-01-28T04:06:31.140010+0000 mon.a (mon.0) 156 : audit [DBG] from='client.? 172.21.15.150:0/175402490' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T04:06:31.941 INFO:tasks.cephadm:Adding mon.b on smithi134 2021-01-28T04:06:31.945 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add mon smithi134:172.21.15.134=b 2021-01-28T04:06:34.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:33 smithi150 bash[9867]: cluster 2021-01-28T04:06:32.774896+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:34.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:33 smithi150 bash[13629]: cluster 2021-01-28T04:06:32.774896+0000 mgr.y (mgr.14138) 42 : cluster [DBG] pgmap v32: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:35.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:35 smithi150 bash[13629]: cluster 2021-01-28T04:06:34.775393+0000 mgr.y (mgr.14138) 43 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:35.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:35 smithi150 bash[13629]: audit 2021-01-28T04:06:35.238615+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:35.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:35 smithi150 bash[13629]: audit 2021-01-28T04:06:35.240801+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:35.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:35 smithi150 bash[13629]: audit 2021-01-28T04:06:35.243362+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T04:06:35.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:35 smithi150 bash[9867]: cluster 2021-01-28T04:06:34.775393+0000 mgr.y (mgr.14138) 43 : cluster [DBG] pgmap v33: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:35.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:35 smithi150 bash[9867]: audit 2021-01-28T04:06:35.238615+0000 mon.a (mon.0) 157 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:35.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:35 smithi150 bash[9867]: audit 2021-01-28T04:06:35.240801+0000 mon.a (mon.0) 158 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:35.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:35 smithi150 bash[9867]: audit 2021-01-28T04:06:35.243362+0000 mon.a (mon.0) 159 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T04:06:36.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:36 smithi150 bash[9867]: audit 2021-01-28T04:06:35.235578+0000 mgr.y (mgr.14138) 44 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi134:172.21.15.134=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:06:36.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:36 smithi150 bash[9867]: cephadm 2021-01-28T04:06:35.242331+0000 mgr.y (mgr.14138) 45 : cephadm [INF] Deploying daemon mon.b on smithi134 2021-01-28T04:06:36.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:36 smithi150 bash[13629]: audit 2021-01-28T04:06:35.235578+0000 mgr.y (mgr.14138) 44 : audit [DBG] from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch daemon add", "daemon_type": "mon", "placement": "smithi134:172.21.15.134=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:06:36.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:36 smithi150 bash[13629]: cephadm 2021-01-28T04:06:35.242331+0000 mgr.y (mgr.14138) 45 : cephadm [INF] Deploying daemon mon.b on smithi134 2021-01-28T04:06:37.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:37 smithi150 bash[9867]: cluster 2021-01-28T04:06:36.775856+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:37.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:37 smithi150 bash[13629]: cluster 2021-01-28T04:06:36.775856+0000 mgr.y (mgr.14138) 46 : cluster [DBG] pgmap v34: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:40.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:39 smithi150 bash[9867]: cluster 2021-01-28T04:06:38.776375+0000 mgr.y (mgr.14138) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:40.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:39 smithi150 bash[13629]: cluster 2021-01-28T04:06:38.776375+0000 mgr.y (mgr.14138) 47 : cluster [DBG] pgmap v35: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:40.280 INFO:teuthology.orchestra.run.smithi134.stdout:Deployed mon.b on host 'smithi134' 2021-01-28T04:06:41.558 DEBUG:teuthology.orchestra.run.smithi134:mon.b> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mon.b.service 2021-01-28T04:06:41.565 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2021-01-28T04:06:41.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph mon dump -f json 2021-01-28T04:06:41.610 INFO:journalctl@ceph.mon.b.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:06:41.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: cephadm 2021-01-28T04:06:40.271462+0000 mgr.y (mgr.14138) 48 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:06:41.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: audit 2021-01-28T04:06:40.276828+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:41.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: audit 2021-01-28T04:06:40.277373+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:41.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: cluster 2021-01-28T04:06:40.776819+0000 mgr.y (mgr.14138) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:41.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: audit 2021-01-28T04:06:40.920364+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:41.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: audit 2021-01-28T04:06:40.928660+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:41.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: audit 2021-01-28T04:06:40.930034+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:41.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: audit 2021-01-28T04:06:40.931521+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:41.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[9867]: audit 2021-01-28T04:06:40.933786+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T04:06:41.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: cephadm 2021-01-28T04:06:40.271462+0000 mgr.y (mgr.14138) 48 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:06:41.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: audit 2021-01-28T04:06:40.276828+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:41.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: audit 2021-01-28T04:06:40.277373+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:41.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: cluster 2021-01-28T04:06:40.776819+0000 mgr.y (mgr.14138) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:41.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: audit 2021-01-28T04:06:40.920364+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:41.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: audit 2021-01-28T04:06:40.928660+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:41.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: audit 2021-01-28T04:06:40.930034+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:41.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: audit 2021-01-28T04:06:40.931521+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:41.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:41 smithi150 bash[13629]: audit 2021-01-28T04:06:40.933786+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T04:06:42.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.832+0000 7fc179179700 0 set uid:gid to 167:167 (ceph:ceph) 2021-01-28T04:06:42.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.832+0000 7fc179179700 0 ceph version 17.0.0-184-g507028cb (507028cb839c25d6666833702df6325fd8569096) quincy (dev), process ceph-mon, pid 1 2021-01-28T04:06:42.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.832+0000 7fc179179700 0 pidfile_write: ignore empty --pid-file 2021-01-28T04:06:42.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 0 load: jerasure load: lrc load: isa 2021-01-28T04:06:42.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: RocksDB version: 6.8.1 2021-01-28T04:06:42.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2021-01-28T04:06:42.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Compile date Jan 27 2021 2021-01-28T04:06:42.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: DB SUMMARY 2021-01-28T04:06:42.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: CURRENT file: CURRENT 2021-01-28T04:06:42.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: IDENTITY file: IDENTITY 2021-01-28T04:06:42.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2021-01-28T04:06:42.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2021-01-28T04:06:42.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000003.log size: 636 ; 2021-01-28T04:06:42.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.error_if_exists: 0 2021-01-28T04:06:42.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.create_if_missing: 0 2021-01-28T04:06:42.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.paranoid_checks: 1 2021-01-28T04:06:42.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.env: 0x56358849c1c0 2021-01-28T04:06:42.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.fs: Posix File System 2021-01-28T04:06:42.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.info_log: 0x56358a587e80 2021-01-28T04:06:42.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_file_opening_threads: 16 2021-01-28T04:06:42.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.statistics: (nil) 2021-01-28T04:06:42.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.use_fsync: 0 2021-01-28T04:06:42.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_log_file_size: 0 2021-01-28T04:06:42.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_manifest_file_size: 1073741824 2021-01-28T04:06:42.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.log_file_time_to_roll: 0 2021-01-28T04:06:42.146 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.keep_log_file_num: 1000 2021-01-28T04:06:42.146 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.recycle_log_file_num: 0 2021-01-28T04:06:42.148 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.allow_fallocate: 1 2021-01-28T04:06:42.148 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.allow_mmap_reads: 0 2021-01-28T04:06:42.148 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.allow_mmap_writes: 0 2021-01-28T04:06:42.148 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.use_direct_reads: 0 2021-01-28T04:06:42.149 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2021-01-28T04:06:42.149 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.create_missing_column_families: 0 2021-01-28T04:06:42.149 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.db_log_dir: 2021-01-28T04:06:42.149 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2021-01-28T04:06:42.149 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.table_cache_numshardbits: 6 2021-01-28T04:06:42.150 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_subcompactions: 1 2021-01-28T04:06:42.150 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_background_flushes: -1 2021-01-28T04:06:42.150 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.WAL_ttl_seconds: 0 2021-01-28T04:06:42.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.WAL_size_limit_MB: 0 2021-01-28T04:06:42.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2021-01-28T04:06:42.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.manifest_preallocation_size: 4194304 2021-01-28T04:06:42.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.is_fd_close_on_exec: 1 2021-01-28T04:06:42.151 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.advise_random_on_open: 1 2021-01-28T04:06:42.152 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.db_write_buffer_size: 0 2021-01-28T04:06:42.152 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.write_buffer_manager: 0x56358a5e1bf0 2021-01-28T04:06:42.152 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.access_hint_on_compaction_start: 1 2021-01-28T04:06:42.152 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2021-01-28T04:06:42.152 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2021-01-28T04:06:42.153 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.use_adaptive_mutex: 0 2021-01-28T04:06:42.153 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.rate_limiter: (nil) 2021-01-28T04:06:42.153 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2021-01-28T04:06:42.153 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.wal_recovery_mode: 2 2021-01-28T04:06:42.153 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.enable_thread_tracking: 0 2021-01-28T04:06:42.154 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.enable_pipelined_write: 0 2021-01-28T04:06:42.154 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.unordered_write: 0 2021-01-28T04:06:42.154 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2021-01-28T04:06:42.155 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2021-01-28T04:06:42.155 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.write_thread_max_yield_usec: 100 2021-01-28T04:06:42.155 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2021-01-28T04:06:42.155 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.row_cache: None 2021-01-28T04:06:42.156 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.wal_filter: None 2021-01-28T04:06:42.156 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.avoid_flush_during_recovery: 0 2021-01-28T04:06:42.156 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.allow_ingest_behind: 0 2021-01-28T04:06:42.157 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.preserve_deletes: 0 2021-01-28T04:06:42.157 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.two_write_queues: 0 2021-01-28T04:06:42.157 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.manual_wal_flush: 0 2021-01-28T04:06:42.157 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.atomic_flush: 0 2021-01-28T04:06:42.157 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2021-01-28T04:06:42.158 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.persist_stats_to_disk: 0 2021-01-28T04:06:42.158 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.write_dbid_to_manifest: 0 2021-01-28T04:06:42.158 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.log_readahead_size: 0 2021-01-28T04:06:42.158 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.sst_file_checksum_func: Unknown 2021-01-28T04:06:42.158 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_background_jobs: 2 2021-01-28T04:06:42.159 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_background_compactions: -1 2021-01-28T04:06:42.159 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2021-01-28T04:06:42.159 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2021-01-28T04:06:42.159 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.delayed_write_rate : 16777216 2021-01-28T04:06:42.159 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_total_wal_size: 0 2021-01-28T04:06:42.160 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2021-01-28T04:06:42.160 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.stats_dump_period_sec: 600 2021-01-28T04:06:42.160 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.stats_persist_period_sec: 600 2021-01-28T04:06:42.160 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.stats_history_buffer_size: 1048576 2021-01-28T04:06:42.161 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_open_files: -1 2021-01-28T04:06:42.161 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bytes_per_sync: 0 2021-01-28T04:06:42.161 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.wal_bytes_per_sync: 0 2021-01-28T04:06:42.162 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.strict_bytes_per_sync: 0 2021-01-28T04:06:42.162 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_readahead_size: 0 2021-01-28T04:06:42.162 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Compression algorithms supported: 2021-01-28T04:06:42.162 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: kZSTDNotFinalCompression supported: 0 2021-01-28T04:06:42.162 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: kZSTD supported: 0 2021-01-28T04:06:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: kXpressCompression supported: 0 2021-01-28T04:06:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: kLZ4HCCompression supported: 1 2021-01-28T04:06:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: kLZ4Compression supported: 1 2021-01-28T04:06:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: kBZip2Compression supported: 0 2021-01-28T04:06:42.163 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: kZlibCompression supported: 1 2021-01-28T04:06:42.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: kSnappyCompression supported: 1 2021-01-28T04:06:42.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Fast CRC32 supported: Supported on x86 2021-01-28T04:06:42.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 2021-01-28T04:06:42.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2021-01-28T04:06:42.164 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2021-01-28T04:06:42.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.merge_operator: 2021-01-28T04:06:42.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_filter: None 2021-01-28T04:06:42.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_filter_factory: None 2021-01-28T04:06:42.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.memtable_factory: SkipListFactory 2021-01-28T04:06:42.165 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.table_factory: BlockBasedTable 2021-01-28T04:06:42.166 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56358a5301e0) 2021-01-28T04:06:42.166 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: cache_index_and_filter_blocks: 1 2021-01-28T04:06:42.166 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: cache_index_and_filter_blocks_with_high_priority: 0 2021-01-28T04:06:42.166 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: pin_l0_filter_and_index_blocks_in_cache: 0 2021-01-28T04:06:42.166 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: pin_top_level_index_and_filter: 1 2021-01-28T04:06:42.167 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: index_type: 0 2021-01-28T04:06:42.167 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: data_block_index_type: 0 2021-01-28T04:06:42.167 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: index_shortening: 1 2021-01-28T04:06:42.167 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: data_block_hash_table_util_ratio: 0.750000 2021-01-28T04:06:42.167 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: hash_index_allow_collision: 1 2021-01-28T04:06:42.168 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: checksum: 1 2021-01-28T04:06:42.168 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: no_block_cache: 0 2021-01-28T04:06:42.168 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: block_cache: 0x56358a568510 2021-01-28T04:06:42.168 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: block_cache_name: BinnedLRUCache 2021-01-28T04:06:42.169 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: block_cache_options: 2021-01-28T04:06:42.169 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: capacity : 536870912 2021-01-28T04:06:42.169 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: num_shard_bits : 4 2021-01-28T04:06:42.170 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: strict_capacity_limit : 0 2021-01-28T04:06:42.170 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: high_pri_pool_ratio: 0.000 2021-01-28T04:06:42.170 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: block_cache_compressed: (nil) 2021-01-28T04:06:42.170 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: persistent_cache: (nil) 2021-01-28T04:06:42.170 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: block_size: 4096 2021-01-28T04:06:42.171 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: block_size_deviation: 10 2021-01-28T04:06:42.171 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: block_restart_interval: 16 2021-01-28T04:06:42.171 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: index_block_restart_interval: 1 2021-01-28T04:06:42.172 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: metadata_block_size: 4096 2021-01-28T04:06:42.172 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: partition_filters: 0 2021-01-28T04:06:42.172 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: use_delta_encoding: 1 2021-01-28T04:06:42.172 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: filter_policy: rocksdb.BuiltinBloomFilter 2021-01-28T04:06:42.172 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: whole_key_filtering: 1 2021-01-28T04:06:42.173 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: verify_compression: 0 2021-01-28T04:06:42.173 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: read_amp_bytes_per_bit: 0 2021-01-28T04:06:42.173 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: format_version: 2 2021-01-28T04:06:42.173 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: enable_index_compression: 1 2021-01-28T04:06:42.173 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: block_align: 0 2021-01-28T04:06:42.174 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.write_buffer_size: 33554432 2021-01-28T04:06:42.174 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_write_buffer_number: 2 2021-01-28T04:06:42.174 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compression: NoCompression 2021-01-28T04:06:42.174 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bottommost_compression: Disabled 2021-01-28T04:06:42.174 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.prefix_extractor: nullptr 2021-01-28T04:06:42.175 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2021-01-28T04:06:42.175 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.num_levels: 7 2021-01-28T04:06:42.175 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2021-01-28T04:06:42.175 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2021-01-28T04:06:42.175 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2021-01-28T04:06:42.176 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2021-01-28T04:06:42.176 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2021-01-28T04:06:42.176 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2021-01-28T04:06:42.176 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2021-01-28T04:06:42.176 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2021-01-28T04:06:42.177 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2021-01-28T04:06:42.177 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compression_opts.window_bits: -14 2021-01-28T04:06:42.177 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compression_opts.level: 32767 2021-01-28T04:06:42.177 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compression_opts.strategy: 0 2021-01-28T04:06:42.177 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2021-01-28T04:06:42.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2021-01-28T04:06:42.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compression_opts.enabled: false 2021-01-28T04:06:42.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2021-01-28T04:06:42.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2021-01-28T04:06:42.178 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.level0_stop_writes_trigger: 36 2021-01-28T04:06:42.179 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.target_file_size_base: 67108864 2021-01-28T04:06:42.179 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.target_file_size_multiplier: 1 2021-01-28T04:06:42.179 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2021-01-28T04:06:42.179 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2021-01-28T04:06:42.179 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2021-01-28T04:06:42.180 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2021-01-28T04:06:42.180 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2021-01-28T04:06:42.180 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2021-01-28T04:06:42.180 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2021-01-28T04:06:42.180 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2021-01-28T04:06:42.181 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2021-01-28T04:06:42.181 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2021-01-28T04:06:42.181 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2021-01-28T04:06:42.181 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_compaction_bytes: 1677721600 2021-01-28T04:06:42.182 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.arena_block_size: 4194304 2021-01-28T04:06:42.182 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2021-01-28T04:06:42.182 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2021-01-28T04:06:42.182 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2021-01-28T04:06:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.disable_auto_compactions: 0 2021-01-28T04:06:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2021-01-28T04:06:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2021-01-28T04:06:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2021-01-28T04:06:42.183 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2021-01-28T04:06:42.184 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2021-01-28T04:06:42.184 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2021-01-28T04:06:42.184 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2021-01-28T04:06:42.184 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2021-01-28T04:06:42.184 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2021-01-28T04:06:42.185 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2021-01-28T04:06:42.185 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.table_properties_collectors: 2021-01-28T04:06:42.185 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.inplace_update_support: 0 2021-01-28T04:06:42.185 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.inplace_update_num_locks: 10000 2021-01-28T04:06:42.185 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2021-01-28T04:06:42.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.memtable_whole_key_filtering: 0 2021-01-28T04:06:42.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.memtable_huge_page_size: 0 2021-01-28T04:06:42.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.bloom_locality: 0 2021-01-28T04:06:42.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.max_successive_merges: 0 2021-01-28T04:06:42.186 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.optimize_filters_for_hits: 0 2021-01-28T04:06:42.187 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.paranoid_file_checks: 0 2021-01-28T04:06:42.187 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.force_consistency_checks: 0 2021-01-28T04:06:42.187 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.report_bg_io_stats: 0 2021-01-28T04:06:42.187 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.ttl: 2592000 2021-01-28T04:06:42.187 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.836+0000 7fc179179700 4 rocksdb: Options.periodic_compaction_seconds: 0 2021-01-28T04:06:42.188 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2021-01-28T04:06:42.188 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2021-01-28T04:06:42.188 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806801841446, "job": 1, "event": "recovery_started", "log_files": [3]} 2021-01-28T04:06:42.188 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2021-01-28T04:06:42.189 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2021-01-28T04:06:42.189 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806801841999, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1562, "table_properties": {"data_size": 648, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1611806801, "oldest_key_time": 3, "file_creation_time": 0}} 2021-01-28T04:06:42.189 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2021-01-28T04:06:42.189 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1611806801842471, "job": 1, "event": "recovery_finished"} 2021-01-28T04:06:42.189 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 4 rocksdb: DB pointer 0x56358a627800 2021-01-28T04:06:42.190 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc15ff9a700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2021-01-28T04:06:42.190 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc15ff9a700 4 rocksdb: [db_impl/db_impl.cc:851] 2021-01-28T04:06:42.190 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ** DB Stats ** 2021-01-28T04:06:42.190 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:06:42.190 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2021-01-28T04:06:42.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2021-01-28T04:06:42.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T04:06:42.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2021-01-28T04:06:42.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2021-01-28T04:06:42.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2021-01-28T04:06:42.192 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ** Compaction Stats [default] ** 2021-01-28T04:06:42.192 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:06:42.192 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:06:42.192 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:42.192 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:42.193 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:42.193 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ** Compaction Stats [default] ** 2021-01-28T04:06:42.193 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:06:42.193 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:06:42.193 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:42.194 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:06:42.194 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T04:06:42.194 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T04:06:42.194 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T04:06:42.194 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T04:06:42.195 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T04:06:42.195 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Cumulative compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:06:42.195 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Interval compaction: 0.00 GB write, 0.38 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:06:42.195 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T04:06:42.195 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T04:06:42.196 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ** Compaction Stats [default] ** 2021-01-28T04:06:42.196 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:06:42.196 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:06:42.196 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: L0 1/0 1.53 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:42.196 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Sum 1/0 1.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.0 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:42.197 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2021-01-28T04:06:42.197 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ** Compaction Stats [default] ** 2021-01-28T04:06:42.197 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2021-01-28T04:06:42.197 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2021-01-28T04:06:42.197 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.0 0.00 0.00 1 0.001 0 0 2021-01-28T04:06:42.198 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Uptime(secs): 0.0 total, 0.0 interval 2021-01-28T04:06:42.198 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Flush(GB): cumulative 0.000, interval 0.000 2021-01-28T04:06:42.198 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: AddFile(GB): cumulative 0.000, interval 0.000 2021-01-28T04:06:42.198 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: AddFile(Total Files): cumulative 0, interval 0 2021-01-28T04:06:42.198 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: AddFile(L0 Files): cumulative 0, interval 0 2021-01-28T04:06:42.199 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: AddFile(Keys): cumulative 0, interval 0 2021-01-28T04:06:42.199 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Cumulative compaction: 0.00 GB write, 0.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:06:42.199 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2021-01-28T04:06:42.199 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2021-01-28T04:06:42.199 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: ** File Read Latency Histogram By Level [default] ** 2021-01-28T04:06:42.200 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.840+0000 7fc179179700 0 mon.b does not exist in monmap, will attempt to join an existing cluster 2021-01-28T04:06:42.200 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.844+0000 7fc179179700 0 using public_addr v2:172.21.15.134:0/0 -> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2021-01-28T04:06:42.200 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.844+0000 7fc179179700 0 starting mon.b rank -1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:06:42.200 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.844+0000 7fc179179700 1 mon.b@-1(???) e0 preinit fsid d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:06:42.200 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 0 mon.b@-1(synchronizing).mds e1 new map 2021-01-28T04:06:42.201 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 0 mon.b@-1(synchronizing).mds e1 print_map 2021-01-28T04:06:42.201 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: e1 2021-01-28T04:06:42.201 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: enable_multiple, ever_enabled_multiple: 1,1 2021-01-28T04:06:42.201 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2021-01-28T04:06:42.201 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: legacy client fscid: -1 2021-01-28T04:06:42.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: 2021-01-28T04:06:42.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: No filesystems configured 2021-01-28T04:06:42.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 1 mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2021-01-28T04:06:42.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 1 mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2021-01-28T04:06:42.202 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 1 mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2021-01-28T04:06:42.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 1 mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2021-01-28T04:06:42.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 1 mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2021-01-28T04:06:42.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 1 mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2021-01-28T04:06:42.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 1 mon.b@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2021-01-28T04:06:42.203 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 1 mon.b@-1(synchronizing).osd e6 e6: 0 total, 0 up, 0 in 2021-01-28T04:06:42.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 0 mon.b@-1(synchronizing).osd e6 crush map has features 3314933000852226048, adjusting msgr requires 2021-01-28T04:06:42.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T04:06:42.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T04:06:42.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.872+0000 7fc16279f700 0 mon.b@-1(synchronizing).osd e6 crush map has features 288514051259236352, adjusting msgr requires 2021-01-28T04:06:42.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: cephadm 2021-01-28T04:06:40.271462+0000 mgr.y (mgr.14138) 48 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:06:42.204 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: audit 2021-01-28T04:06:40.276828+0000 mon.a (mon.0) 160 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:42.205 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: audit 2021-01-28T04:06:40.277373+0000 mon.a (mon.0) 161 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:42.205 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: cluster 2021-01-28T04:06:40.776819+0000 mgr.y (mgr.14138) 49 : cluster [DBG] pgmap v36: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:42.205 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: audit 2021-01-28T04:06:40.920364+0000 mon.a (mon.0) 162 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:42.205 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: audit 2021-01-28T04:06:40.928660+0000 mon.a (mon.0) 163 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:42.206 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: audit 2021-01-28T04:06:40.930034+0000 mon.a (mon.0) 164 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:42.206 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: audit 2021-01-28T04:06:40.931521+0000 mon.a (mon.0) 165 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:42.206 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: audit 2021-01-28T04:06:40.933786+0000 mon.a (mon.0) 166 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T04:06:42.206 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 1 mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2021-01-28T04:06:42.206 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta expand map: {default=false} 2021-01-28T04:06:42.207 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta from 'false' to 'false' 2021-01-28T04:06:42.207 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta expanded map: {default=false} 2021-01-28T04:06:42.207 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta expand map: {default=info} 2021-01-28T04:06:42.207 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta from 'info' to 'info' 2021-01-28T04:06:42.207 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta expanded map: {default=info} 2021-01-28T04:06:42.208 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta expand map: {default=daemon} 2021-01-28T04:06:42.208 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta from 'daemon' to 'daemon' 2021-01-28T04:06:42.208 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta expanded map: {default=daemon} 2021-01-28T04:06:42.208 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta expand map: {default=debug} 2021-01-28T04:06:42.208 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta from 'debug' to 'debug' 2021-01-28T04:06:42.209 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 20 expand_channel_meta expanded map: {default=debug} 2021-01-28T04:06:42.209 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:41 smithi134 bash[9858]: debug 2021-01-28T04:06:41.876+0000 7fc16279f700 10 mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete 2021-01-28T04:06:47.337 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cephadm 2021-01-28T04:06:40.929544+0000 mgr.y (mgr.14138) 50 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T04:06:47.337 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cephadm 2021-01-28T04:06:40.932832+0000 mgr.y (mgr.14138) 51 : cephadm [INF] Reconfiguring daemon mon.a on smithi150 2021-01-28T04:06:47.338 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:41.896403+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-28T04:06:47.338 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:41.901405+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-28T04:06:47.338 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:42.777301+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.338 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:42.887421+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.338 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:43.886159+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-28T04:06:47.339 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:43.887501+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.339 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:44.777778+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.339 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:44.887543+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.339 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:45.887745+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.340 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:46.778202+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.340 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:46.887881+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.340 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:46.922712+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-28T04:06:47.340 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:46.931554+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],b=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],c=[v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0]} 2021-01-28T04:06:47.340 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:46.931649+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-28T04:06:47.341 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:46.931704+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T04:06:47.341 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:46.932041+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-28T04:06:47.341 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: cluster 2021-01-28T04:06:46.939685+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2021-01-28T04:06:47.341 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:46.946660+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:47.341 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:46.947981+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-28T04:06:47.342 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:46.949390+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:47.342 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[9867]: audit 2021-01-28T04:06:46.951396+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-28T04:06:47.342 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cephadm 2021-01-28T04:06:40.929544+0000 mgr.y (mgr.14138) 50 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T04:06:47.342 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cephadm 2021-01-28T04:06:40.932832+0000 mgr.y (mgr.14138) 51 : cephadm [INF] Reconfiguring daemon mon.a on smithi150 2021-01-28T04:06:47.343 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:41.896403+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-28T04:06:47.343 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:41.901405+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-28T04:06:47.343 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:42.777301+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.343 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:42.887421+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.343 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:43.886159+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-28T04:06:47.344 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:43.887501+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.344 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:44.777778+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.344 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:44.887543+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.344 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:45.887745+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.344 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:46.778202+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.345 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:46.887881+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.345 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:46.922712+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-28T04:06:47.345 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:46.931554+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],b=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],c=[v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0]} 2021-01-28T04:06:47.345 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:46.931649+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-28T04:06:47.345 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:46.931704+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T04:06:47.346 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:46.932041+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-28T04:06:47.346 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: cluster 2021-01-28T04:06:46.939685+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2021-01-28T04:06:47.346 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:46.946660+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:47.346 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:46.947981+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-28T04:06:47.347 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:46.949390+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:47.347 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:46 smithi150 bash[13629]: audit 2021-01-28T04:06:46.951396+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-28T04:06:47.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cephadm 2021-01-28T04:06:40.929544+0000 mgr.y (mgr.14138) 50 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T04:06:47.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cephadm 2021-01-28T04:06:40.932832+0000 mgr.y (mgr.14138) 51 : cephadm [INF] Reconfiguring daemon mon.a on smithi150 2021-01-28T04:06:47.390 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:41.896403+0000 mon.a (mon.0) 168 : cluster [INF] mon.a calling monitor election 2021-01-28T04:06:47.390 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:41.901405+0000 mon.c (mon.1) 2 : cluster [INF] mon.c calling monitor election 2021-01-28T04:06:47.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:42.777301+0000 mgr.y (mgr.14138) 52 : cluster [DBG] pgmap v37: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:42.887421+0000 mon.a (mon.0) 169 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:43.886159+0000 mon.b (mon.2) 1 : cluster [INF] mon.b calling monitor election 2021-01-28T04:06:47.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:43.887501+0000 mon.a (mon.0) 170 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:44.777778+0000 mgr.y (mgr.14138) 53 : cluster [DBG] pgmap v38: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:44.887543+0000 mon.a (mon.0) 171 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:45.887745+0000 mon.a (mon.0) 172 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.393 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:46.778202+0000 mgr.y (mgr.14138) 54 : cluster [DBG] pgmap v39: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:47.393 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:46.887881+0000 mon.a (mon.0) 173 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:47.393 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:46.922712+0000 mon.a (mon.0) 174 : cluster [INF] mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2021-01-28T04:06:47.393 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:46.931554+0000 mon.a (mon.0) 175 : cluster [DBG] monmap e3: 3 mons at {a=[v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0],b=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0],c=[v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0]} 2021-01-28T04:06:47.393 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:46.931649+0000 mon.a (mon.0) 176 : cluster [DBG] fsmap 2021-01-28T04:06:47.394 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:46.931704+0000 mon.a (mon.0) 177 : cluster [DBG] osdmap e6: 0 total, 0 up, 0 in 2021-01-28T04:06:47.394 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:46.932041+0000 mon.a (mon.0) 178 : cluster [DBG] mgrmap e13: y(active, since 86s) 2021-01-28T04:06:47.394 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: cluster 2021-01-28T04:06:46.939685+0000 mon.a (mon.0) 179 : cluster [INF] overall HEALTH_OK 2021-01-28T04:06:47.395 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:46.946660+0000 mon.a (mon.0) 180 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:47.395 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:46.947981+0000 mon.a (mon.0) 181 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mgr.y"}]: dispatch 2021-01-28T04:06:47.396 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:46.949390+0000 mon.a (mon.0) 182 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:47.396 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:46 smithi134 bash[9858]: audit 2021-01-28T04:06:46.951396+0000 mon.a (mon.0) 183 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.y", "key": "container_image"}]: dispatch 2021-01-28T04:06:48.167 INFO:teuthology.orchestra.run.smithi134.stdout: 2021-01-28T04:06:48.167 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":3,"fsid":"d0bb049a-611d-11eb-8f9e-001a4aab830c","modified":"2021-01-28T04:06:41.888117Z","created":"2021-01-28T04:04:18.633601Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3300","nonce":0},{"type":"v1","addr":"172.21.15.150:6789","nonce":0}]},"addr":"172.21.15.150:6789/0","public_addr":"172.21.15.150:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:3301","nonce":0},{"type":"v1","addr":"172.21.15.150:6790","nonce":0}]},"addr":"172.21.15.150:6790/0","public_addr":"172.21.15.150:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2021-01-28T04:06:48.170 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 3 2021-01-28T04:06:48.253 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:47 smithi134 bash[9858]: cephadm 2021-01-28T04:06:46.947547+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-28T04:06:48.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:47 smithi134 bash[9858]: cephadm 2021-01-28T04:06:46.950531+0000 mgr.y (mgr.14138) 56 : cephadm [INF] Reconfiguring daemon mgr.y on smithi150 2021-01-28T04:06:48.254 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:47 smithi134 bash[9858]: audit 2021-01-28T04:06:47.888249+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:48.385 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:48 smithi150 bash[9867]: cephadm 2021-01-28T04:06:46.947547+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-28T04:06:48.385 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:48 smithi150 bash[9867]: cephadm 2021-01-28T04:06:46.950531+0000 mgr.y (mgr.14138) 56 : cephadm [INF] Reconfiguring daemon mgr.y on smithi150 2021-01-28T04:06:48.386 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:48 smithi150 bash[9867]: audit 2021-01-28T04:06:47.888249+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:48.386 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:48 smithi150 bash[13629]: cephadm 2021-01-28T04:06:46.947547+0000 mgr.y (mgr.14138) 55 : cephadm [INF] Reconfiguring mgr.y (monmap changed)... 2021-01-28T04:06:48.387 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:48 smithi150 bash[13629]: cephadm 2021-01-28T04:06:46.950531+0000 mgr.y (mgr.14138) 56 : cephadm [INF] Reconfiguring daemon mgr.y on smithi150 2021-01-28T04:06:48.387 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:48 smithi150 bash[13629]: audit 2021-01-28T04:06:47.888249+0000 mon.a (mon.0) 184 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2021-01-28T04:06:48.961 INFO:tasks.cephadm:Generating final ceph.conf file... 2021-01-28T04:06:48.964 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph config generate-minimal-conf 2021-01-28T04:06:49.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:49 smithi134 bash[9858]: audit 2021-01-28T04:06:48.170309+0000 mon.c (mon.1) 3 : audit [DBG] from='client.? 172.21.15.134:0/2002001819' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T04:06:49.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:49 smithi134 bash[9858]: cluster 2021-01-28T04:06:48.778688+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:49.471 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:49 smithi150 bash[9867]: audit 2021-01-28T04:06:48.170309+0000 mon.c (mon.1) 3 : audit [DBG] from='client.? 172.21.15.134:0/2002001819' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T04:06:49.471 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:49 smithi150 bash[9867]: cluster 2021-01-28T04:06:48.778688+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:49.472 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:49 smithi150 bash[13629]: audit 2021-01-28T04:06:48.170309+0000 mon.c (mon.1) 3 : audit [DBG] from='client.? 172.21.15.134:0/2002001819' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T04:06:49.472 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:49 smithi150 bash[13629]: cluster 2021-01-28T04:06:48.778688+0000 mgr.y (mgr.14138) 57 : cluster [DBG] pgmap v40: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:50.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[9867]: audit 2021-01-28T04:06:49.729014+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:50.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[9867]: cephadm 2021-01-28T04:06:49.729886+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-28T04:06:50.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[9867]: audit 2021-01-28T04:06:49.730319+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:50.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[9867]: audit 2021-01-28T04:06:49.731634+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:50.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[9867]: cephadm 2021-01-28T04:06:49.732635+0000 mgr.y (mgr.14138) 59 : cephadm [INF] Reconfiguring daemon mon.c on smithi150 2021-01-28T04:06:50.981 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[9867]: audit 2021-01-28T04:06:49.733390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-28T04:06:50.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[13629]: audit 2021-01-28T04:06:49.729014+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:50.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[13629]: cephadm 2021-01-28T04:06:49.729886+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-28T04:06:50.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[13629]: audit 2021-01-28T04:06:49.730319+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:50.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[13629]: audit 2021-01-28T04:06:49.731634+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:50.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[13629]: cephadm 2021-01-28T04:06:49.732635+0000 mgr.y (mgr.14138) 59 : cephadm [INF] Reconfiguring daemon mon.c on smithi150 2021-01-28T04:06:50.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:50 smithi150 bash[13629]: audit 2021-01-28T04:06:49.733390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-28T04:06:51.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:50 smithi134 bash[9858]: audit 2021-01-28T04:06:49.729014+0000 mon.a (mon.0) 185 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:51.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:50 smithi134 bash[9858]: cephadm 2021-01-28T04:06:49.729886+0000 mgr.y (mgr.14138) 58 : cephadm [INF] Reconfiguring mon.c (monmap changed)... 2021-01-28T04:06:51.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:50 smithi134 bash[9858]: audit 2021-01-28T04:06:49.730319+0000 mon.a (mon.0) 186 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:51.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:50 smithi134 bash[9858]: audit 2021-01-28T04:06:49.731634+0000 mon.a (mon.0) 187 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:51.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:50 smithi134 bash[9858]: cephadm 2021-01-28T04:06:49.732635+0000 mgr.y (mgr.14138) 59 : cephadm [INF] Reconfiguring daemon mon.c on smithi150 2021-01-28T04:06:51.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:50 smithi134 bash[9858]: audit 2021-01-28T04:06:49.733390+0000 mon.a (mon.0) 188 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.c", "key": "container_image"}]: dispatch 2021-01-28T04:06:52.063 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:51 smithi150 bash[9867]: cluster 2021-01-28T04:06:50.779151+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:52.063 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:51 smithi150 bash[13629]: cluster 2021-01-28T04:06:50.779151+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:52.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:51 smithi134 bash[9858]: cluster 2021-01-28T04:06:50.779151+0000 mgr.y (mgr.14138) 60 : cluster [DBG] pgmap v41: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:53.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[9867]: cluster 2021-01-28T04:06:52.779683+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:53.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[9867]: audit 2021-01-28T04:06:53.564231+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:53.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[9867]: audit 2021-01-28T04:06:53.565647+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:53.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[9867]: audit 2021-01-28T04:06:53.567106+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:53.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[9867]: audit 2021-01-28T04:06:53.569315+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T04:06:53.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[13629]: cluster 2021-01-28T04:06:52.779683+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:53.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[13629]: audit 2021-01-28T04:06:53.564231+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:53.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[13629]: audit 2021-01-28T04:06:53.565647+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:53.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[13629]: audit 2021-01-28T04:06:53.567106+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:53.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:53 smithi150 bash[13629]: audit 2021-01-28T04:06:53.569315+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T04:06:54.044 INFO:teuthology.orchestra.run.smithi150.stdout:# minimal ceph.conf for d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:06:54.044 INFO:teuthology.orchestra.run.smithi150.stdout:[global] 2021-01-28T04:06:54.044 INFO:teuthology.orchestra.run.smithi150.stdout: fsid = d0bb049a-611d-11eb-8f9e-001a4aab830c 2021-01-28T04:06:54.044 INFO:teuthology.orchestra.run.smithi150.stdout: mon_host = [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] 2021-01-28T04:06:54.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:53 smithi134 bash[9858]: cluster 2021-01-28T04:06:52.779683+0000 mgr.y (mgr.14138) 61 : cluster [DBG] pgmap v42: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:54.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:53 smithi134 bash[9858]: audit 2021-01-28T04:06:53.564231+0000 mon.a (mon.0) 189 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:54.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:53 smithi134 bash[9858]: audit 2021-01-28T04:06:53.565647+0000 mon.a (mon.0) 190 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:54.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:53 smithi134 bash[9858]: audit 2021-01-28T04:06:53.567106+0000 mon.a (mon.0) 191 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:54.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:53 smithi134 bash[9858]: audit 2021-01-28T04:06:53.569315+0000 mon.a (mon.0) 192 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.b", "key": "container_image"}]: dispatch 2021-01-28T04:06:54.819 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2021-01-28T04:06:54.819 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:06:54.820 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.conf 2021-01-28T04:06:54.882 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:06:54.883 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-28T04:06:54.903 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:06:54.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2021-01-28T04:06:54.924 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:06:54.924 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2021-01-28T04:06:54.978 INFO:tasks.cephadm:Adding mgr.y on smithi150 2021-01-28T04:06:54.979 INFO:tasks.cephadm:Adding mgr.x on smithi134 2021-01-28T04:06:54.980 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch apply mgr '3;smithi150=y;smithi134=x' 2021-01-28T04:06:55.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:54 smithi134 bash[9858]: cephadm 2021-01-28T04:06:53.565199+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-28T04:06:55.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:54 smithi134 bash[9858]: cephadm 2021-01-28T04:06:53.568418+0000 mgr.y (mgr.14138) 63 : cephadm [INF] Reconfiguring daemon mon.b on smithi134 2021-01-28T04:06:55.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:54 smithi134 bash[9858]: audit 2021-01-28T04:06:54.047763+0000 mon.a (mon.0) 193 : audit [DBG] from='client.? 172.21.15.150:0/187730718' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:55.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:54 smithi150 bash[9867]: cephadm 2021-01-28T04:06:53.565199+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-28T04:06:55.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:54 smithi150 bash[9867]: cephadm 2021-01-28T04:06:53.568418+0000 mgr.y (mgr.14138) 63 : cephadm [INF] Reconfiguring daemon mon.b on smithi134 2021-01-28T04:06:55.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:54 smithi150 bash[9867]: audit 2021-01-28T04:06:54.047763+0000 mon.a (mon.0) 193 : audit [DBG] from='client.? 172.21.15.150:0/187730718' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:55.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:54 smithi150 bash[13629]: cephadm 2021-01-28T04:06:53.565199+0000 mgr.y (mgr.14138) 62 : cephadm [INF] Reconfiguring mon.b (monmap changed)... 2021-01-28T04:06:55.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:54 smithi150 bash[13629]: cephadm 2021-01-28T04:06:53.568418+0000 mgr.y (mgr.14138) 63 : cephadm [INF] Reconfiguring daemon mon.b on smithi134 2021-01-28T04:06:55.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:54 smithi150 bash[13629]: audit 2021-01-28T04:06:54.047763+0000 mon.a (mon.0) 193 : audit [DBG] from='client.? 172.21.15.150:0/187730718' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:56.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:55 smithi134 bash[9858]: cluster 2021-01-28T04:06:54.780153+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:56.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:55 smithi150 bash[13629]: cluster 2021-01-28T04:06:54.780153+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:56.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:55 smithi150 bash[9867]: cluster 2021-01-28T04:06:54.780153+0000 mgr.y (mgr.14138) 64 : cluster [DBG] pgmap v43: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:57.471 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:56.196262+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:56.198631+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:57.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:56.199226+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:57.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: cluster 2021-01-28T04:06:56.780674+0000 mgr.y (mgr.14138) 65 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:57.472 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:56.865511+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:56.991311+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:56.996152+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:56.997412+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:57.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:56.998780+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:57.473 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[9867]: audit 2021-01-28T04:06:57.000504+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T04:06:57.474 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:56.196262+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.474 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:56.198631+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:57.474 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:56.199226+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:57.474 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: cluster 2021-01-28T04:06:56.780674+0000 mgr.y (mgr.14138) 65 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:57.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:56.865511+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:56.991311+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:56.996152+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:56.997412+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:57.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:56.998780+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:57.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:57 smithi150 bash[13629]: audit 2021-01-28T04:06:57.000504+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T04:06:57.484 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:56.196262+0000 mon.a (mon.0) 194 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.484 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:56.198631+0000 mon.a (mon.0) 195 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:57.485 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:56.199226+0000 mon.a (mon.0) 196 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:57.485 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: cluster 2021-01-28T04:06:56.780674+0000 mgr.y (mgr.14138) 65 : cluster [DBG] pgmap v44: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:57.486 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:56.865511+0000 mon.a (mon.0) 197 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.486 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:56.991311+0000 mon.a (mon.0) 198 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.486 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:56.996152+0000 mon.a (mon.0) 199 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:56.997412+0000 mon.a (mon.0) 200 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2021-01-28T04:06:57.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:56.998780+0000 mon.a (mon.0) 201 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:06:57.488 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:57 smithi134 bash[9858]: audit 2021-01-28T04:06:57.000504+0000 mon.a (mon.0) 202 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon.a", "key": "container_image"}]: dispatch 2021-01-28T04:06:58.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:58 smithi150 bash[9867]: cephadm 2021-01-28T04:06:56.996818+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T04:06:58.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:58 smithi150 bash[9867]: cephadm 2021-01-28T04:06:56.999665+0000 mgr.y (mgr.14138) 67 : cephadm [INF] Reconfiguring daemon mon.a on smithi150 2021-01-28T04:06:58.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:58 smithi150 bash[13629]: cephadm 2021-01-28T04:06:56.996818+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T04:06:58.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:58 smithi150 bash[13629]: cephadm 2021-01-28T04:06:56.999665+0000 mgr.y (mgr.14138) 67 : cephadm [INF] Reconfiguring daemon mon.a on smithi150 2021-01-28T04:06:58.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:58 smithi134 bash[9858]: cephadm 2021-01-28T04:06:56.996818+0000 mgr.y (mgr.14138) 66 : cephadm [INF] Reconfiguring mon.a (monmap changed)... 2021-01-28T04:06:58.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:58 smithi134 bash[9858]: cephadm 2021-01-28T04:06:56.999665+0000 mgr.y (mgr.14138) 67 : cephadm [INF] Reconfiguring daemon mon.a on smithi150 2021-01-28T04:06:58.938 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mgr update... 2021-01-28T04:06:59.646 DEBUG:teuthology.orchestra.run.smithi134:mgr.x> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@mgr.x.service 2021-01-28T04:06:59.649 INFO:tasks.cephadm:Deploying OSDs... 2021-01-28T04:06:59.649 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:06:59.649 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/scratch_devs of=/dev/stdout 2021-01-28T04:06:59.656 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-28T04:06:59.657 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-28T04:06:59.664 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-28T04:06:59.664 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T04:06:59.664 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 344 Links: 1 2021-01-28T04:06:59.665 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T04:06:59.665 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2021-01-28 04:01:07.519696755 +0000 2021-01-28T04:06:59.665 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2021-01-28 04:01:07.351696758 +0000 2021-01-28T04:06:59.665 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2021-01-28 04:01:07.351696758 +0000 2021-01-28T04:06:59.665 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2021-01-28T04:06:59.674 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2021-01-28T04:06:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2021-01-28T04:06:59.675 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000391474 s, 1.3 MB/s 2021-01-28T04:06:59.677 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-28T04:06:59.680 INFO:journalctl@ceph.mgr.x.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:06:59.683 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-28T04:06:59.683 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T04:06:59.684 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 350 Links: 1 2021-01-28T04:06:59.684 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T04:06:59.684 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2021-01-28 04:01:07.891696746 +0000 2021-01-28T04:06:59.684 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2021-01-28 04:01:07.727696750 +0000 2021-01-28T04:06:59.685 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2021-01-28 04:01:07.727696750 +0000 2021-01-28T04:06:59.685 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2021-01-28T04:06:59.691 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2021-01-28T04:06:59.691 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2021-01-28T04:06:59.692 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000337552 s, 1.5 MB/s 2021-01-28T04:06:59.696 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-28T04:06:59.747 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-28T04:06:59.747 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T04:06:59.748 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-01-28T04:06:59.748 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T04:06:59.748 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2021-01-28 04:01:08.295696737 +0000 2021-01-28T04:06:59.749 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2021-01-28 04:01:08.111696741 +0000 2021-01-28T04:06:59.749 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2021-01-28 04:01:08.111696741 +0000 2021-01-28T04:06:59.749 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2021-01-28T04:06:59.757 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2021-01-28T04:06:59.757 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2021-01-28T04:06:59.757 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000410582 s, 1.2 MB/s 2021-01-28T04:06:59.761 DEBUG:teuthology.orchestra.run.smithi150:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-28T04:06:59.767 INFO:teuthology.orchestra.run.smithi150.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-28T04:06:59.767 INFO:teuthology.orchestra.run.smithi150.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T04:06:59.767 INFO:teuthology.orchestra.run.smithi150.stdout:Device: 6h/6d Inode: 367 Links: 1 2021-01-28T04:06:59.768 INFO:teuthology.orchestra.run.smithi150.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T04:06:59.768 INFO:teuthology.orchestra.run.smithi150.stdout:Access: 2021-01-28 04:01:08.679696729 +0000 2021-01-28T04:06:59.768 INFO:teuthology.orchestra.run.smithi150.stdout:Modify: 2021-01-28 04:01:08.519696732 +0000 2021-01-28T04:06:59.768 INFO:teuthology.orchestra.run.smithi150.stdout:Change: 2021-01-28 04:01:08.519696732 +0000 2021-01-28T04:06:59.769 INFO:teuthology.orchestra.run.smithi150.stdout: Birth: - 2021-01-28T04:06:59.770 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:59 smithi150 bash[13629]: cluster 2021-01-28T04:06:58.781259+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:59.770 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:59 smithi150 bash[13629]: audit 2021-01-28T04:06:58.940711+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:59.771 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:59 smithi150 bash[13629]: audit 2021-01-28T04:06:59.348291+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:59.771 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:06:59 smithi150 bash[13629]: audit 2021-01-28T04:06:59.350836+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:59.771 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:59 smithi150 bash[9867]: cluster 2021-01-28T04:06:58.781259+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:59.771 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:59 smithi150 bash[9867]: audit 2021-01-28T04:06:58.940711+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:59.772 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:59 smithi150 bash[9867]: audit 2021-01-28T04:06:59.348291+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:59.772 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:06:59 smithi150 bash[9867]: audit 2021-01-28T04:06:59.350836+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:59.773 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records in 2021-01-28T04:06:59.773 INFO:teuthology.orchestra.run.smithi150.stderr:1+0 records out 2021-01-28T04:06:59.773 INFO:teuthology.orchestra.run.smithi150.stderr:512 bytes copied, 0.000338267 s, 1.5 MB/s 2021-01-28T04:06:59.774 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:06:59.775 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2021-01-28T04:06:59.783 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2021-01-28T04:06:59.783 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2021-01-28T04:06:59.830 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2021-01-28T04:06:59.830 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T04:06:59.830 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 345 Links: 1 2021-01-28T04:06:59.830 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T04:06:59.831 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2021-01-28 04:01:05.857295093 +0000 2021-01-28T04:06:59.831 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2021-01-28 04:01:05.685295093 +0000 2021-01-28T04:06:59.831 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2021-01-28 04:01:05.685295093 +0000 2021-01-28T04:06:59.831 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2021-01-28T04:06:59.837 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:59 smithi134 bash[9858]: cluster 2021-01-28T04:06:58.781259+0000 mgr.y (mgr.14138) 68 : cluster [DBG] pgmap v45: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:06:59.837 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:59 smithi134 bash[9858]: audit 2021-01-28T04:06:58.940711+0000 mon.a (mon.0) 203 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:59.837 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:59 smithi134 bash[9858]: audit 2021-01-28T04:06:59.348291+0000 mon.a (mon.0) 204 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:06:59.838 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:06:59 smithi134 bash[9858]: audit 2021-01-28T04:06:59.350836+0000 mon.a (mon.0) 205 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:06:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2021-01-28T04:06:59.839 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2021-01-28T04:06:59.840 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000389813 s, 1.3 MB/s 2021-01-28T04:06:59.844 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2021-01-28T04:06:59.850 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2021-01-28T04:06:59.851 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T04:06:59.851 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 350 Links: 1 2021-01-28T04:06:59.851 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T04:06:59.851 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2021-01-28 04:01:06.229295093 +0000 2021-01-28T04:06:59.851 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2021-01-28 04:01:06.069295093 +0000 2021-01-28T04:06:59.852 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2021-01-28 04:01:06.069295093 +0000 2021-01-28T04:06:59.852 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2021-01-28T04:06:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2021-01-28T04:06:59.860 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2021-01-28T04:06:59.861 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00030325 s, 1.7 MB/s 2021-01-28T04:06:59.865 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2021-01-28T04:06:59.871 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2021-01-28T04:06:59.871 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T04:06:59.871 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 360 Links: 1 2021-01-28T04:06:59.871 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T04:06:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2021-01-28 04:01:06.653295093 +0000 2021-01-28T04:06:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2021-01-28 04:01:06.473295093 +0000 2021-01-28T04:06:59.872 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2021-01-28 04:01:06.473295093 +0000 2021-01-28T04:06:59.872 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2021-01-28T04:06:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2021-01-28T04:06:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2021-01-28T04:06:59.880 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000406709 s, 1.3 MB/s 2021-01-28T04:06:59.884 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2021-01-28T04:06:59.891 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2021-01-28T04:06:59.891 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2021-01-28T04:06:59.892 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 365 Links: 1 2021-01-28T04:06:59.892 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2021-01-28T04:06:59.893 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2021-01-28 04:01:07.057295093 +0000 2021-01-28T04:06:59.893 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2021-01-28 04:01:06.869295093 +0000 2021-01-28T04:06:59.893 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2021-01-28 04:01:06.869295093 +0000 2021-01-28T04:06:59.895 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2021-01-28T04:06:59.900 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2021-01-28T04:06:59.901 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2021-01-28T04:06:59.902 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000383757 s, 1.3 MB/s 2021-01-28T04:06:59.904 INFO:tasks.cephadm:Deploying osd.0 on smithi150 with /dev/vg_nvme/lv_4... 2021-01-28T04:06:59.906 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-28T04:07:00.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: audit 2021-01-28T04:06:58.932091+0000 mgr.y (mgr.14138) 69 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi150=y;smithi134=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:00.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: cephadm 2021-01-28T04:06:58.934321+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Saving service mgr spec with placement smithi150=y;smithi134=x;count:3 2021-01-28T04:07:00.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: audit 2021-01-28T04:07:00.108534+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:00.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: audit 2021-01-28T04:07:00.113797+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:00.890 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: audit 2021-01-28T04:07:00.115183+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-28T04:07:00.890 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: audit 2021-01-28T04:07:00.117956+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-28T04:07:00.890 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: audit 2021-01-28T04:07:00.118786+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-28T04:07:00.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: audit 2021-01-28T04:07:00.119880+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:00.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:00 smithi134 bash[9858]: audit 2021-01-28T04:07:00.121006+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-28T04:07:00.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: audit 2021-01-28T04:06:58.932091+0000 mgr.y (mgr.14138) 69 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi150=y;smithi134=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:00.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: cephadm 2021-01-28T04:06:58.934321+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Saving service mgr spec with placement smithi150=y;smithi134=x;count:3 2021-01-28T04:07:00.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: audit 2021-01-28T04:07:00.108534+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:00.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: audit 2021-01-28T04:07:00.113797+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:00.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: audit 2021-01-28T04:07:00.115183+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-28T04:07:00.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: audit 2021-01-28T04:07:00.117956+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-28T04:07:00.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: audit 2021-01-28T04:07:00.118786+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-28T04:07:00.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: audit 2021-01-28T04:07:00.119880+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:00.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[9867]: audit 2021-01-28T04:07:00.121006+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-28T04:07:00.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: audit 2021-01-28T04:06:58.932091+0000 mgr.y (mgr.14138) 69 : audit [DBG] from='client.34106 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi150=y;smithi134=x", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:00.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: cephadm 2021-01-28T04:06:58.934321+0000 mgr.y (mgr.14138) 70 : cephadm [INF] Saving service mgr spec with placement smithi150=y;smithi134=x;count:3 2021-01-28T04:07:00.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: audit 2021-01-28T04:07:00.108534+0000 mon.a (mon.0) 206 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:00.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: audit 2021-01-28T04:07:00.113797+0000 mon.a (mon.0) 207 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:00.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: audit 2021-01-28T04:07:00.115183+0000 mon.a (mon.0) 208 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2021-01-28T04:07:00.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: audit 2021-01-28T04:07:00.117956+0000 mon.a (mon.0) 209 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2021-01-28T04:07:00.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: audit 2021-01-28T04:07:00.118786+0000 mon.a (mon.0) 210 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2021-01-28T04:07:00.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: audit 2021-01-28T04:07:00.119880+0000 mon.a (mon.0) 211 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:00.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:00 smithi150 bash[13629]: audit 2021-01-28T04:07:00.121006+0000 mon.a (mon.0) 212 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mgr.x", "key": "container_image"}]: dispatch 2021-01-28T04:07:01.870 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:01 smithi134 bash[9858]: cephadm 2021-01-28T04:07:00.114560+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='x')] 2021-01-28T04:07:01.871 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:01 smithi134 bash[9858]: cephadm 2021-01-28T04:07:00.120451+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Deploying daemon mgr.x on smithi134 2021-01-28T04:07:01.871 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:01 smithi134 bash[9858]: cluster 2021-01-28T04:07:00.781794+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:01.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:01 smithi150 bash[9867]: cephadm 2021-01-28T04:07:00.114560+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='x')] 2021-01-28T04:07:01.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:01 smithi150 bash[9867]: cephadm 2021-01-28T04:07:00.120451+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Deploying daemon mgr.x on smithi134 2021-01-28T04:07:01.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:01 smithi150 bash[9867]: cluster 2021-01-28T04:07:00.781794+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:01.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:01 smithi150 bash[13629]: cephadm 2021-01-28T04:07:00.114560+0000 mgr.y (mgr.14138) 71 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y')] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='x')] 2021-01-28T04:07:01.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:01 smithi150 bash[13629]: cephadm 2021-01-28T04:07:00.120451+0000 mgr.y (mgr.14138) 72 : cephadm [INF] Deploying daemon mgr.x on smithi134 2021-01-28T04:07:01.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:01 smithi150 bash[13629]: cluster 2021-01-28T04:07:00.781794+0000 mgr.y (mgr.14138) 73 : cluster [DBG] pgmap v46: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:03.019 INFO:journalctl@ceph.mgr.x.smithi134.stdout:Jan 28 04:07:02 smithi134 systemd[1]: Started Ceph mgr.x for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:07:03.723 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-28T04:07:03.724 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-28T04:07:03.724 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2021-01-28T04:07:03.724 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2021-01-28T04:07:03.724 INFO:teuthology.orchestra.run.smithi150.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0154149 s, 680 MB/s 2021-01-28T04:07:03.725 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2021-01-28T04:07:04.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:03 smithi134 bash[9858]: cluster 2021-01-28T04:07:02.782295+0000 mgr.y (mgr.14138) 74 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:04.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:03 smithi134 bash[9858]: audit 2021-01-28T04:07:02.963556+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:03 smithi134 bash[9858]: audit 2021-01-28T04:07:02.966216+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:04.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:03 smithi134 bash[9858]: audit 2021-01-28T04:07:02.966994+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:04.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:03 smithi134 bash[9858]: audit 2021-01-28T04:07:03.752301+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:03 smithi134 bash[9858]: audit 2021-01-28T04:07:03.826250+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:03 smithi134 bash[9858]: audit 2021-01-28T04:07:03.833807+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[9867]: cluster 2021-01-28T04:07:02.782295+0000 mgr.y (mgr.14138) 74 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:04.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[9867]: audit 2021-01-28T04:07:02.963556+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[9867]: audit 2021-01-28T04:07:02.966216+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:04.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[9867]: audit 2021-01-28T04:07:02.966994+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:04.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[9867]: audit 2021-01-28T04:07:03.752301+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[9867]: audit 2021-01-28T04:07:03.826250+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[9867]: audit 2021-01-28T04:07:03.833807+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[13629]: cluster 2021-01-28T04:07:02.782295+0000 mgr.y (mgr.14138) 74 : cluster [DBG] pgmap v47: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:04.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[13629]: audit 2021-01-28T04:07:02.963556+0000 mon.a (mon.0) 213 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[13629]: audit 2021-01-28T04:07:02.966216+0000 mon.a (mon.0) 214 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:04.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[13629]: audit 2021-01-28T04:07:02.966994+0000 mon.a (mon.0) 215 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:04.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[13629]: audit 2021-01-28T04:07:03.752301+0000 mon.a (mon.0) 216 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[13629]: audit 2021-01-28T04:07:03.826250+0000 mon.a (mon.0) 217 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:03 smithi150 bash[13629]: audit 2021-01-28T04:07:03.833807+0000 mon.a (mon.0) 218 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.484 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi150:vg_nvme/lv_4 2021-01-28T04:07:04.638 INFO:journalctl@ceph.mgr.x.smithi134.stdout:Jan 28 04:07:04 smithi134 bash[10585]: debug 2021-01-28T04:07:04.188+0000 7f7ddbb58700 1 -- 172.21.15.134:0/3648803705 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x556d291544e0 con 0x556d29240c00 2021-01-28T04:07:04.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:04 smithi150 bash[9867]: cephadm 2021-01-28T04:07:03.834866+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:04.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:04 smithi150 bash[9867]: audit 2021-01-28T04:07:03.836924+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:04.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:04 smithi150 bash[9867]: audit 2021-01-28T04:07:04.627512+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:04 smithi150 bash[9867]: audit 2021-01-28T04:07:04.631966+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:04 smithi150 bash[13629]: cephadm 2021-01-28T04:07:03.834866+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:04.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:04 smithi150 bash[13629]: audit 2021-01-28T04:07:03.836924+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:04.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:04 smithi150 bash[13629]: audit 2021-01-28T04:07:04.627512+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:04.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:04 smithi150 bash[13629]: audit 2021-01-28T04:07:04.631966+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:05.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:04 smithi134 bash[9858]: cephadm 2021-01-28T04:07:03.834866+0000 mgr.y (mgr.14138) 75 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:05.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:04 smithi134 bash[9858]: audit 2021-01-28T04:07:03.836924+0000 mon.a (mon.0) 219 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:05.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:04 smithi134 bash[9858]: audit 2021-01-28T04:07:04.627512+0000 mon.a (mon.0) 220 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:05.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:04 smithi134 bash[9858]: audit 2021-01-28T04:07:04.631966+0000 mon.a (mon.0) 221 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:05.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:05 smithi150 bash[13629]: cephadm 2021-01-28T04:07:04.632849+0000 mgr.y (mgr.14138) 76 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:05.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:05 smithi150 bash[13629]: cluster 2021-01-28T04:07:04.782807+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:05.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:05 smithi150 bash[9867]: cephadm 2021-01-28T04:07:04.632849+0000 mgr.y (mgr.14138) 76 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:05.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:05 smithi150 bash[9867]: cluster 2021-01-28T04:07:04.782807+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:06.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:05 smithi134 bash[9858]: cephadm 2021-01-28T04:07:04.632849+0000 mgr.y (mgr.14138) 76 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:06.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:05 smithi134 bash[9858]: cluster 2021-01-28T04:07:04.782807+0000 mgr.y (mgr.14138) 77 : cluster [DBG] pgmap v48: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:07.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:07 smithi134 bash[9858]: cluster 2021-01-28T04:07:06.783226+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:07.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:07 smithi150 bash[9867]: cluster 2021-01-28T04:07:06.783226+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:07.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:07 smithi150 bash[13629]: cluster 2021-01-28T04:07:06.783226+0000 mgr.y (mgr.14138) 78 : cluster [DBG] pgmap v49: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:08.721 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:08 smithi150 bash[13629]: audit 2021-01-28T04:07:07.957698+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:07:08.721 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:08 smithi150 bash[13629]: audit 2021-01-28T04:07:07.961855+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:07:08.721 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:08 smithi150 bash[13629]: audit 2021-01-28T04:07:07.963518+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:08.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:08 smithi150 bash[13629]: audit 2021-01-28T04:07:07.965545+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:08.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:08 smithi150 bash[9867]: audit 2021-01-28T04:07:07.957698+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:07:08.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:08 smithi150 bash[9867]: audit 2021-01-28T04:07:07.961855+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:07:08.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:08 smithi150 bash[9867]: audit 2021-01-28T04:07:07.963518+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:08.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:08 smithi150 bash[9867]: audit 2021-01-28T04:07:07.965545+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:08.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:08 smithi134 bash[9858]: audit 2021-01-28T04:07:07.957698+0000 mon.a (mon.0) 222 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:07:08.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:08 smithi134 bash[9858]: audit 2021-01-28T04:07:07.961855+0000 mon.a (mon.0) 223 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:07:08.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:08 smithi134 bash[9858]: audit 2021-01-28T04:07:07.963518+0000 mon.a (mon.0) 224 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:08.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:08 smithi134 bash[9858]: audit 2021-01-28T04:07:07.965545+0000 mon.a (mon.0) 225 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:09.801 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:09 smithi150 bash[13629]: audit 2021-01-28T04:07:07.955615+0000 mgr.y (mgr.14138) 79 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:09.801 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:09 smithi150 bash[13629]: cephadm 2021-01-28T04:07:07.961287+0000 mgr.y (mgr.14138) 80 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:07:09.802 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:09 smithi150 bash[13629]: cluster 2021-01-28T04:07:08.783717+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:09.802 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:09 smithi150 bash[9867]: audit 2021-01-28T04:07:07.955615+0000 mgr.y (mgr.14138) 79 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:09.802 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:09 smithi150 bash[9867]: cephadm 2021-01-28T04:07:07.961287+0000 mgr.y (mgr.14138) 80 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:07:09.802 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:09 smithi150 bash[9867]: cluster 2021-01-28T04:07:08.783717+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:09.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:09 smithi134 bash[9858]: audit 2021-01-28T04:07:07.955615+0000 mgr.y (mgr.14138) 79 : audit [DBG] from='client.14199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:09.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:09 smithi134 bash[9858]: cephadm 2021-01-28T04:07:07.961287+0000 mgr.y (mgr.14138) 80 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:07:09.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:09 smithi134 bash[9858]: cluster 2021-01-28T04:07:08.783717+0000 mgr.y (mgr.14138) 81 : cluster [DBG] pgmap v50: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:10.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:10 smithi150 bash[9867]: cluster 2021-01-28T04:07:09.948525+0000 mon.a (mon.0) 226 : cluster [DBG] Standby manager daemon x started 2021-01-28T04:07:10.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:10 smithi150 bash[9867]: audit 2021-01-28T04:07:09.949249+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.134:0/4028979992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-28T04:07:10.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:10 smithi150 bash[9867]: audit 2021-01-28T04:07:09.951459+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.134:0/4028979992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-28T04:07:10.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:10 smithi150 bash[13629]: cluster 2021-01-28T04:07:09.948525+0000 mon.a (mon.0) 226 : cluster [DBG] Standby manager daemon x started 2021-01-28T04:07:10.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:10 smithi150 bash[13629]: audit 2021-01-28T04:07:09.949249+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.134:0/4028979992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-28T04:07:10.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:10 smithi150 bash[13629]: audit 2021-01-28T04:07:09.951459+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.134:0/4028979992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-28T04:07:10.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:10 smithi134 bash[9858]: cluster 2021-01-28T04:07:09.948525+0000 mon.a (mon.0) 226 : cluster [DBG] Standby manager daemon x started 2021-01-28T04:07:10.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:10 smithi134 bash[9858]: audit 2021-01-28T04:07:09.949249+0000 mon.c (mon.1) 4 : audit [DBG] from='mgr.? 172.21.15.134:0/4028979992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2021-01-28T04:07:10.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:10 smithi134 bash[9858]: audit 2021-01-28T04:07:09.951459+0000 mon.c (mon.1) 5 : audit [DBG] from='mgr.? 172.21.15.134:0/4028979992' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2021-01-28T04:07:11.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:11 smithi150 bash[9867]: cluster 2021-01-28T04:07:10.542025+0000 mon.a (mon.0) 227 : cluster [DBG] mgrmap e14: y(active, since 109s), standbys: x 2021-01-28T04:07:11.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:11 smithi150 bash[9867]: audit 2021-01-28T04:07:10.542193+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-28T04:07:11.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:11 smithi150 bash[9867]: cluster 2021-01-28T04:07:10.784172+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:11.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:11 smithi150 bash[13629]: cluster 2021-01-28T04:07:10.542025+0000 mon.a (mon.0) 227 : cluster [DBG] mgrmap e14: y(active, since 109s), standbys: x 2021-01-28T04:07:11.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:11 smithi150 bash[13629]: audit 2021-01-28T04:07:10.542193+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-28T04:07:11.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:11 smithi150 bash[13629]: cluster 2021-01-28T04:07:10.784172+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:11.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:11 smithi134 bash[9858]: cluster 2021-01-28T04:07:10.542025+0000 mon.a (mon.0) 227 : cluster [DBG] mgrmap e14: y(active, since 109s), standbys: x 2021-01-28T04:07:11.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:11 smithi134 bash[9858]: audit 2021-01-28T04:07:10.542193+0000 mon.a (mon.0) 228 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2021-01-28T04:07:11.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:11 smithi134 bash[9858]: cluster 2021-01-28T04:07:10.784172+0000 mgr.y (mgr.14138) 82 : cluster [DBG] pgmap v51: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:12.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:12 smithi134 bash[9858]: audit 2021-01-28T04:07:12.209573+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.150:0/3897165387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]: dispatch 2021-01-28T04:07:12.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:12 smithi134 bash[9858]: audit 2021-01-28T04:07:12.210164+0000 mon.a (mon.0) 229 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]: dispatch 2021-01-28T04:07:12.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:12 smithi134 bash[9858]: audit 2021-01-28T04:07:12.214794+0000 mon.a (mon.0) 230 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]': finished 2021-01-28T04:07:12.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:12 smithi134 bash[9858]: cluster 2021-01-28T04:07:12.214834+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-28T04:07:12.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:12 smithi134 bash[9858]: audit 2021-01-28T04:07:12.214929+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:12.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[9867]: audit 2021-01-28T04:07:12.209573+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.150:0/3897165387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]: dispatch 2021-01-28T04:07:12.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[9867]: audit 2021-01-28T04:07:12.210164+0000 mon.a (mon.0) 229 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]: dispatch 2021-01-28T04:07:12.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[9867]: audit 2021-01-28T04:07:12.214794+0000 mon.a (mon.0) 230 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]': finished 2021-01-28T04:07:12.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[9867]: cluster 2021-01-28T04:07:12.214834+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-28T04:07:12.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[9867]: audit 2021-01-28T04:07:12.214929+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:12.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[13629]: audit 2021-01-28T04:07:12.209573+0000 mon.c (mon.1) 6 : audit [INF] from='client.? 172.21.15.150:0/3897165387' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]: dispatch 2021-01-28T04:07:12.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[13629]: audit 2021-01-28T04:07:12.210164+0000 mon.a (mon.0) 229 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]: dispatch 2021-01-28T04:07:12.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[13629]: audit 2021-01-28T04:07:12.214794+0000 mon.a (mon.0) 230 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbd745cc-a38a-42b7-beb3-7c3d2fcb148e"}]': finished 2021-01-28T04:07:12.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[13629]: cluster 2021-01-28T04:07:12.214834+0000 mon.a (mon.0) 231 : cluster [DBG] osdmap e7: 1 total, 0 up, 0 in 2021-01-28T04:07:12.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:12 smithi150 bash[13629]: audit 2021-01-28T04:07:12.214929+0000 mon.a (mon.0) 232 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:13.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:13 smithi134 bash[9858]: cluster 2021-01-28T04:07:12.784648+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:13.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:13 smithi134 bash[9858]: audit 2021-01-28T04:07:12.882905+0000 mon.a (mon.0) 233 : audit [DBG] from='client.? 172.21.15.150:0/2061768858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:07:13.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:13 smithi150 bash[13629]: cluster 2021-01-28T04:07:12.784648+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:13.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:13 smithi150 bash[13629]: audit 2021-01-28T04:07:12.882905+0000 mon.a (mon.0) 233 : audit [DBG] from='client.? 172.21.15.150:0/2061768858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:07:13.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:13 smithi150 bash[9867]: cluster 2021-01-28T04:07:12.784648+0000 mgr.y (mgr.14138) 83 : cluster [DBG] pgmap v53: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:13.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:13 smithi150 bash[9867]: audit 2021-01-28T04:07:12.882905+0000 mon.a (mon.0) 233 : audit [DBG] from='client.? 172.21.15.150:0/2061768858' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:07:16.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:15 smithi134 bash[9858]: cluster 2021-01-28T04:07:14.785144+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:16.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:15 smithi150 bash[9867]: cluster 2021-01-28T04:07:14.785144+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:16.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:15 smithi150 bash[13629]: cluster 2021-01-28T04:07:14.785144+0000 mgr.y (mgr.14138) 84 : cluster [DBG] pgmap v54: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:17.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:16 smithi134 bash[9858]: audit 2021-01-28T04:07:16.147854+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:17.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:16 smithi150 bash[9867]: audit 2021-01-28T04:07:16.147854+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:17.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:16 smithi150 bash[13629]: audit 2021-01-28T04:07:16.147854+0000 mon.a (mon.0) 234 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:18.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:17 smithi134 bash[9858]: cluster 2021-01-28T04:07:16.785671+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:18.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:17 smithi134 bash[9858]: cluster 2021-01-28T04:07:17.511558+0000 mon.a (mon.0) 235 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T04:07:18.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:17 smithi150 bash[9867]: cluster 2021-01-28T04:07:16.785671+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:18.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:17 smithi150 bash[9867]: cluster 2021-01-28T04:07:17.511558+0000 mon.a (mon.0) 235 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T04:07:18.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:17 smithi150 bash[13629]: cluster 2021-01-28T04:07:16.785671+0000 mgr.y (mgr.14138) 85 : cluster [DBG] pgmap v55: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:18.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:17 smithi150 bash[13629]: cluster 2021-01-28T04:07:17.511558+0000 mon.a (mon.0) 235 : cluster [WRN] Health check failed: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T04:07:20.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:19 smithi134 bash[9858]: cluster 2021-01-28T04:07:18.786202+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:20.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:19 smithi150 bash[9867]: cluster 2021-01-28T04:07:18.786202+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:20.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:19 smithi150 bash[13629]: cluster 2021-01-28T04:07:18.786202+0000 mgr.y (mgr.14138) 86 : cluster [DBG] pgmap v56: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:21.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:20 smithi134 bash[9858]: audit 2021-01-28T04:07:20.645214+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-28T04:07:21.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:20 smithi134 bash[9858]: audit 2021-01-28T04:07:20.646907+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:21.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:20 smithi134 bash[9858]: audit 2021-01-28T04:07:20.648868+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-28T04:07:21.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:20 smithi150 bash[9867]: audit 2021-01-28T04:07:20.645214+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-28T04:07:21.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:20 smithi150 bash[9867]: audit 2021-01-28T04:07:20.646907+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:21.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:20 smithi150 bash[9867]: audit 2021-01-28T04:07:20.648868+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-28T04:07:21.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:20 smithi150 bash[13629]: audit 2021-01-28T04:07:20.645214+0000 mon.a (mon.0) 236 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2021-01-28T04:07:21.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:20 smithi150 bash[13629]: audit 2021-01-28T04:07:20.646907+0000 mon.a (mon.0) 237 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:21.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:20 smithi150 bash[13629]: audit 2021-01-28T04:07:20.648868+0000 mon.a (mon.0) 238 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.0", "key": "container_image"}]: dispatch 2021-01-28T04:07:22.129 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:21 smithi150 bash[9867]: cephadm 2021-01-28T04:07:20.648223+0000 mgr.y (mgr.14138) 87 : cephadm [INF] Deploying daemon osd.0 on smithi150 2021-01-28T04:07:22.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:21 smithi150 bash[9867]: cluster 2021-01-28T04:07:20.786794+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:22.130 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:21 smithi150 bash[9867]: audit 2021-01-28T04:07:20.936022+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:07:22.131 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:21 smithi150 bash[9867]: audit 2021-01-28T04:07:20.945213+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:07:22.131 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:21 smithi150 bash[13629]: cephadm 2021-01-28T04:07:20.648223+0000 mgr.y (mgr.14138) 87 : cephadm [INF] Deploying daemon osd.0 on smithi150 2021-01-28T04:07:22.131 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:21 smithi150 bash[13629]: cluster 2021-01-28T04:07:20.786794+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:22.132 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:21 smithi150 bash[13629]: audit 2021-01-28T04:07:20.936022+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:07:22.132 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:21 smithi150 bash[13629]: audit 2021-01-28T04:07:20.945213+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:07:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:21 smithi134 bash[9858]: cephadm 2021-01-28T04:07:20.648223+0000 mgr.y (mgr.14138) 87 : cephadm [INF] Deploying daemon osd.0 on smithi150 2021-01-28T04:07:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:21 smithi134 bash[9858]: cluster 2021-01-28T04:07:20.786794+0000 mgr.y (mgr.14138) 88 : cluster [DBG] pgmap v57: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:22.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:21 smithi134 bash[9858]: audit 2021-01-28T04:07:20.936022+0000 mon.a (mon.0) 239 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:07:22.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:21 smithi134 bash[9858]: audit 2021-01-28T04:07:20.945213+0000 mon.a (mon.0) 240 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:07:23.392 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 0 on host 'smithi150' 2021-01-28T04:07:24.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:23 smithi134 bash[9858]: cluster 2021-01-28T04:07:22.787438+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:24.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:23 smithi134 bash[9858]: audit 2021-01-28T04:07:23.391205+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:24.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:23 smithi134 bash[9858]: audit 2021-01-28T04:07:23.395407+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:24.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:23 smithi150 bash[9867]: cluster 2021-01-28T04:07:22.787438+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:24.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:23 smithi150 bash[9867]: audit 2021-01-28T04:07:23.391205+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:24.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:23 smithi150 bash[9867]: audit 2021-01-28T04:07:23.395407+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:24.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:23 smithi150 bash[13629]: cluster 2021-01-28T04:07:22.787438+0000 mgr.y (mgr.14138) 89 : cluster [DBG] pgmap v58: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:24.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:23 smithi150 bash[13629]: audit 2021-01-28T04:07:23.391205+0000 mon.a (mon.0) 241 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:24.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:23 smithi150 bash[13629]: audit 2021-01-28T04:07:23.395407+0000 mon.a (mon.0) 242 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:24.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:24 smithi150 bash[9867]: cephadm 2021-01-28T04:07:23.391052+0000 mgr.y (mgr.14138) 90 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:07:24.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:24 smithi150 bash[9867]: audit 2021-01-28T04:07:24.254216+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:24.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:24 smithi150 bash[9867]: audit 2021-01-28T04:07:24.255668+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:24.970 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:24 smithi150 bash[13629]: cephadm 2021-01-28T04:07:23.391052+0000 mgr.y (mgr.14138) 90 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:07:24.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:24 smithi150 bash[13629]: audit 2021-01-28T04:07:24.254216+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:24.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:24 smithi150 bash[13629]: audit 2021-01-28T04:07:24.255668+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:24.972 DEBUG:teuthology.orchestra.run.smithi150:osd.0> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@osd.0.service 2021-01-28T04:07:24.975 INFO:tasks.cephadm:Deploying osd.1 on smithi150 with /dev/vg_nvme/lv_3... 2021-01-28T04:07:24.976 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-28T04:07:25.034 INFO:journalctl@ceph.osd.0.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:07:25.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:24 smithi134 bash[9858]: cephadm 2021-01-28T04:07:23.391052+0000 mgr.y (mgr.14138) 90 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:07:25.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:24 smithi134 bash[9858]: audit 2021-01-28T04:07:24.254216+0000 mon.a (mon.0) 243 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:25.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:24 smithi134 bash[9858]: audit 2021-01-28T04:07:24.255668+0000 mon.a (mon.0) 244 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:26.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:25 smithi134 bash[9858]: cluster 2021-01-28T04:07:24.788029+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:26.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:25 smithi150 bash[9867]: cluster 2021-01-28T04:07:24.788029+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:26.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:25 smithi150 bash[13629]: cluster 2021-01-28T04:07:24.788029+0000 mgr.y (mgr.14138) 91 : cluster [DBG] pgmap v59: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:26.658 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:26 smithi150 bash[16412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-28T04:07:26.659 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:26 smithi150 bash[16412]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2021-01-28T04:07:26.659 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:26 smithi150 bash[16412]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2021-01-28T04:07:26.659 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:26 smithi150 bash[16412]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2021-01-28T04:07:26.659 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:26 smithi150 bash[16412]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-28T04:07:26.660 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:26 smithi150 bash[16412]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2021-01-28T04:07:26.660 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:26 smithi150 bash[16412]: --> ceph-volume lvm activate successful for osd ID: 0 2021-01-28T04:07:27.680 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:27 smithi150 bash[13629]: cluster 2021-01-28T04:07:26.788549+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:27.680 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:27 smithi150 bash[9867]: cluster 2021-01-28T04:07:26.788549+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:27.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:27 smithi134 bash[9858]: cluster 2021-01-28T04:07:26.788549+0000 mgr.y (mgr.14138) 92 : cluster [DBG] pgmap v60: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:30.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:29 smithi134 bash[9858]: cluster 2021-01-28T04:07:28.789129+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:30.208 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:29 smithi150 bash[9867]: cluster 2021-01-28T04:07:28.789129+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:30.209 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:29 smithi150 bash[13629]: cluster 2021-01-28T04:07:28.789129+0000 mgr.y (mgr.14138) 93 : cluster [DBG] pgmap v61: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:30.470 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd72b674700 10 --2- 172.21.15.150:0/2697305020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b9ef16f400 0x55b9ef0dc300 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rev1=1 rx=0x55b9ef0ebe60 tx=0x55b9ef120d80).handle_read_frame_dispatch tag=17 2021-01-28T04:07:30.471 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd72b674700 20 --2- 172.21.15.150:0/2697305020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b9ef16f400 0x55b9ef0dc300 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rev1=1 rx=0x55b9ef0ebe60 tx=0x55b9ef120d80).handle_message 2021-01-28T04:07:30.471 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd72b674700 5 --2- 172.21.15.150:0/2697305020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b9ef16f400 0x55b9ef0dc300 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rev1=1 rx=0x55b9ef0ebe60 tx=0x55b9ef120d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0 2021-01-28T04:07:30.471 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd72b674700 5 --2- 172.21.15.150:0/2697305020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b9ef16f400 0x55b9ef0dc300 secure :-1 s=READ_MESSAGE_COMPLETE pgs=10 cs=0 l=1 rev1=1 rx=0x55b9ef0ebe60 tx=0x55b9ef120d80).handle_message received message m=0x55b9ef0f04e0 seq=4 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T04:07:30.472 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd72b674700 20 -- 172.21.15.150:0/2697305020 queue 0x55b9ef0f04e0 prio 196 2021-01-28T04:07:30.472 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd72b674700 20 --2- 172.21.15.150:0/2697305020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b9ef16f400 0x55b9ef0dc300 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x55b9ef0ebe60 tx=0x55b9ef120d80).read_frame 2021-01-28T04:07:30.472 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd729e71700 1 -- 172.21.15.150:0/2697305020 <== mon.1 v2:172.21.15.150:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55b9ef0f04e0 con 0x55b9ef16f400 2021-01-28T04:07:30.473 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd72b674700 20 -- 172.21.15.150:0/2697305020 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x55b9ef16f400 msgr2=0x55b9ef0dc300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T04:07:30.473 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd729e71700 10 -- 172.21.15.150:0/2697305020 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T04:07:30.473 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.315+0000 7fd729e71700 20 -- 172.21.15.150:0/2697305020 done calling dispatch on 0x55b9ef0f04e0 2021-01-28T04:07:31.164 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:30 smithi150 bash[16733]: debug 2021-01-28T04:07:30.855+0000 7fd7318fc200 -1 Falling back to public interface 2021-01-28T04:07:32.054 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-28T04:07:32.054 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-28T04:07:32.055 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2021-01-28T04:07:32.055 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2021-01-28T04:07:32.055 INFO:teuthology.orchestra.run.smithi150.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0187699 s, 559 MB/s 2021-01-28T04:07:32.055 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 2021-01-28T04:07:32.055 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2021-01-28T04:07:32.121 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:31 smithi150 bash[13629]: cluster 2021-01-28T04:07:30.789670+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:32.122 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:31 smithi150 bash[9867]: cluster 2021-01-28T04:07:30.789670+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:32.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:31 smithi134 bash[9858]: cluster 2021-01-28T04:07:30.789670+0000 mgr.y (mgr.14138) 94 : cluster [DBG] pgmap v62: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:33.053 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi150:vg_nvme/lv_3 2021-01-28T04:07:34.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:33 smithi134 bash[9858]: cluster 2021-01-28T04:07:32.790166+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:34.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:33 smithi134 bash[9858]: audit 2021-01-28T04:07:33.833167+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:34.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:33 smithi150 bash[9867]: cluster 2021-01-28T04:07:32.790166+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:34.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:33 smithi150 bash[9867]: audit 2021-01-28T04:07:33.833167+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:34.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:33 smithi150 bash[13629]: cluster 2021-01-28T04:07:32.790166+0000 mgr.y (mgr.14138) 95 : cluster [DBG] pgmap v63: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:34.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:33 smithi150 bash[13629]: audit 2021-01-28T04:07:33.833167+0000 mon.a (mon.0) 245 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:34.221 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:33 smithi150 bash[16733]: debug 2021-01-28T04:07:33.919+0000 7fd7318fc200 -1 osd.0 0 log_to_monitors {default=true} 2021-01-28T04:07:35.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:34 smithi134 bash[9858]: audit 2021-01-28T04:07:33.931327+0000 mon.a (mon.0) 246 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T04:07:35.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:34 smithi134 bash[9858]: audit 2021-01-28T04:07:34.188058+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:35.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:34 smithi134 bash[9858]: audit 2021-01-28T04:07:34.196566+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:35.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:34 smithi134 bash[9858]: audit 2021-01-28T04:07:34.204584+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:35.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:34 smithi150 bash[9867]: audit 2021-01-28T04:07:33.931327+0000 mon.a (mon.0) 246 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T04:07:35.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:34 smithi150 bash[9867]: audit 2021-01-28T04:07:34.188058+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:35.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:34 smithi150 bash[9867]: audit 2021-01-28T04:07:34.196566+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:35.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:34 smithi150 bash[9867]: audit 2021-01-28T04:07:34.204584+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:35.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: audit 2021-01-28T04:07:33.931327+0000 mon.a (mon.0) 246 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2021-01-28T04:07:35.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: audit 2021-01-28T04:07:34.188058+0000 mon.a (mon.0) 247 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:35.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: audit 2021-01-28T04:07:34.196566+0000 mon.a (mon.0) 248 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:35.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: audit 2021-01-28T04:07:34.204584+0000 mon.a (mon.0) 249 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:36.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:35 smithi134 bash[9858]: cephadm 2021-01-28T04:07:34.197556+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:36.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:35 smithi134 bash[9858]: cephadm 2021-01-28T04:07:34.205523+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:36.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:35 smithi134 bash[9858]: cluster 2021-01-28T04:07:34.790731+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v64: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:36.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:35 smithi134 bash[9858]: audit 2021-01-28T04:07:34.872372+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-28T04:07:36.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:35 smithi134 bash[9858]: cluster 2021-01-28T04:07:34.872522+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-28T04:07:36.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:35 smithi134 bash[9858]: audit 2021-01-28T04:07:34.872701+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:36.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:35 smithi134 bash[9858]: audit 2021-01-28T04:07:34.873493+0000 mon.a (mon.0) 253 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:07:36.220 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[16733]: debug 2021-01-28T04:07:35.883+0000 7fd727e6d700 -1 osd.0 0 waiting for initial osdmap 2021-01-28T04:07:36.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[9867]: cephadm 2021-01-28T04:07:34.197556+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:36.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[9867]: cephadm 2021-01-28T04:07:34.205523+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:36.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[9867]: cluster 2021-01-28T04:07:34.790731+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v64: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:36.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[9867]: audit 2021-01-28T04:07:34.872372+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-28T04:07:36.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[9867]: cluster 2021-01-28T04:07:34.872522+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-28T04:07:36.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[9867]: audit 2021-01-28T04:07:34.872701+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:36.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[9867]: audit 2021-01-28T04:07:34.873493+0000 mon.a (mon.0) 253 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:07:36.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: cephadm 2021-01-28T04:07:34.197556+0000 mgr.y (mgr.14138) 96 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:36.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: cephadm 2021-01-28T04:07:34.205523+0000 mgr.y (mgr.14138) 97 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:07:36.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: cluster 2021-01-28T04:07:34.790731+0000 mgr.y (mgr.14138) 98 : cluster [DBG] pgmap v64: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:36.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: audit 2021-01-28T04:07:34.872372+0000 mon.a (mon.0) 250 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2021-01-28T04:07:36.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: cluster 2021-01-28T04:07:34.872522+0000 mon.a (mon.0) 251 : cluster [DBG] osdmap e8: 1 total, 0 up, 0 in 2021-01-28T04:07:36.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: audit 2021-01-28T04:07:34.872701+0000 mon.a (mon.0) 252 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:36.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:35 smithi150 bash[13629]: audit 2021-01-28T04:07:34.873493+0000 mon.a (mon.0) 253 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:07:36.970 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:36 smithi150 bash[13629]: audit 2021-01-28T04:07:35.875774+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:07:36.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:36 smithi150 bash[13629]: cluster 2021-01-28T04:07:35.875952+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-28T04:07:36.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:36 smithi150 bash[13629]: audit 2021-01-28T04:07:35.876780+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:36.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:36 smithi150 bash[13629]: audit 2021-01-28T04:07:35.887313+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:36.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:36 smithi150 bash[9867]: audit 2021-01-28T04:07:35.875774+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:07:36.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:36 smithi150 bash[9867]: cluster 2021-01-28T04:07:35.875952+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-28T04:07:36.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:36 smithi150 bash[9867]: audit 2021-01-28T04:07:35.876780+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:36.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:36 smithi150 bash[9867]: audit 2021-01-28T04:07:35.887313+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:37.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:36 smithi134 bash[9858]: audit 2021-01-28T04:07:35.875774+0000 mon.a (mon.0) 254 : audit [INF] from='osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:07:37.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:36 smithi134 bash[9858]: cluster 2021-01-28T04:07:35.875952+0000 mon.a (mon.0) 255 : cluster [DBG] osdmap e9: 1 total, 0 up, 0 in 2021-01-28T04:07:37.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:36 smithi134 bash[9858]: audit 2021-01-28T04:07:35.876780+0000 mon.a (mon.0) 256 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:37.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:36 smithi134 bash[9858]: audit 2021-01-28T04:07:35.887313+0000 mon.a (mon.0) 257 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:38.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: cluster 2021-01-28T04:07:34.961460+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:07:38.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: cluster 2021-01-28T04:07:34.961680+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:07:38.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: cluster 2021-01-28T04:07:36.791156+0000 mgr.y (mgr.14138) 99 : cluster [DBG] pgmap v67: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:38.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: cluster 2021-01-28T04:07:36.889287+0000 mon.a (mon.0) 258 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:07:38.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: cluster 2021-01-28T04:07:36.889388+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-28T04:07:38.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: audit 2021-01-28T04:07:36.890453+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:38.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: audit 2021-01-28T04:07:37.103526+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:07:38.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: audit 2021-01-28T04:07:37.106182+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:07:38.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: audit 2021-01-28T04:07:37.107715+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:38.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: audit 2021-01-28T04:07:37.109551+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:38.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[9867]: cluster 2021-01-28T04:07:37.892201+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-28T04:07:38.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: cluster 2021-01-28T04:07:34.961460+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:07:38.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: cluster 2021-01-28T04:07:34.961680+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:07:38.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: cluster 2021-01-28T04:07:36.791156+0000 mgr.y (mgr.14138) 99 : cluster [DBG] pgmap v67: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:38.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: cluster 2021-01-28T04:07:36.889287+0000 mon.a (mon.0) 258 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:07:38.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: cluster 2021-01-28T04:07:36.889388+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-28T04:07:38.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: audit 2021-01-28T04:07:36.890453+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:38.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: audit 2021-01-28T04:07:37.103526+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:07:38.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: audit 2021-01-28T04:07:37.106182+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:07:38.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: audit 2021-01-28T04:07:37.107715+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:38.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: audit 2021-01-28T04:07:37.109551+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:38.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:37 smithi150 bash[13629]: cluster 2021-01-28T04:07:37.892201+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-28T04:07:38.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: cluster 2021-01-28T04:07:34.961460+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:07:38.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: cluster 2021-01-28T04:07:34.961680+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:07:38.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: cluster 2021-01-28T04:07:36.791156+0000 mgr.y (mgr.14138) 99 : cluster [DBG] pgmap v67: 1 pgs: 1 unknown; 0 B data, 0 B used, 0 B / 0 B avail 2021-01-28T04:07:38.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: cluster 2021-01-28T04:07:36.889287+0000 mon.a (mon.0) 258 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:07:38.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: cluster 2021-01-28T04:07:36.889388+0000 mon.a (mon.0) 259 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2021-01-28T04:07:38.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: audit 2021-01-28T04:07:36.890453+0000 mon.a (mon.0) 260 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:07:38.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: audit 2021-01-28T04:07:37.103526+0000 mon.a (mon.0) 261 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:07:38.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: audit 2021-01-28T04:07:37.106182+0000 mon.a (mon.0) 262 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:07:38.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: audit 2021-01-28T04:07:37.107715+0000 mon.a (mon.0) 263 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:38.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: audit 2021-01-28T04:07:37.109551+0000 mon.a (mon.0) 264 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:38.390 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:37 smithi134 bash[9858]: cluster 2021-01-28T04:07:37.892201+0000 mon.a (mon.0) 265 : cluster [DBG] osdmap e11: 1 total, 1 up, 1 in 2021-01-28T04:07:39.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:38 smithi150 bash[9867]: audit 2021-01-28T04:07:37.102290+0000 mgr.y (mgr.14138) 100 : audit [DBG] from='client.34142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:39.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:38 smithi150 bash[9867]: cephadm 2021-01-28T04:07:37.105696+0000 mgr.y (mgr.14138) 101 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:07:39.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:38 smithi150 bash[9867]: cluster 2021-01-28T04:07:38.893339+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-28T04:07:39.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:38 smithi150 bash[13629]: audit 2021-01-28T04:07:37.102290+0000 mgr.y (mgr.14138) 100 : audit [DBG] from='client.34142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:39.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:38 smithi150 bash[13629]: cephadm 2021-01-28T04:07:37.105696+0000 mgr.y (mgr.14138) 101 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:07:39.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:38 smithi150 bash[13629]: cluster 2021-01-28T04:07:38.893339+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-28T04:07:39.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:38 smithi134 bash[9858]: audit 2021-01-28T04:07:37.102290+0000 mgr.y (mgr.14138) 100 : audit [DBG] from='client.34142 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:07:39.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:38 smithi134 bash[9858]: cephadm 2021-01-28T04:07:37.105696+0000 mgr.y (mgr.14138) 101 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:07:39.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:38 smithi134 bash[9858]: cluster 2021-01-28T04:07:38.893339+0000 mon.a (mon.0) 266 : cluster [DBG] osdmap e12: 1 total, 1 up, 1 in 2021-01-28T04:07:40.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:39 smithi150 bash[9867]: cluster 2021-01-28T04:07:38.791716+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:40.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:39 smithi150 bash[9867]: cluster 2021-01-28T04:07:38.896705+0000 mon.a (mon.0) 267 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-28T04:07:40.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:39 smithi150 bash[13629]: cluster 2021-01-28T04:07:38.791716+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:40.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:39 smithi150 bash[13629]: cluster 2021-01-28T04:07:38.896705+0000 mon.a (mon.0) 267 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-28T04:07:40.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:39 smithi134 bash[9858]: cluster 2021-01-28T04:07:38.791716+0000 mgr.y (mgr.14138) 102 : cluster [DBG] pgmap v70: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:40.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:39 smithi134 bash[9858]: cluster 2021-01-28T04:07:38.896705+0000 mon.a (mon.0) 267 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive, 1 pg peering (PG_AVAILABILITY) 2021-01-28T04:07:42.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[9867]: cluster 2021-01-28T04:07:40.792278+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:43.580 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[9867]: audit 2021-01-28T04:07:41.399716+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.150:0/354449214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]: dispatch 2021-01-28T04:07:43.581 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[9867]: audit 2021-01-28T04:07:41.400244+0000 mon.a (mon.0) 268 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]: dispatch 2021-01-28T04:07:43.581 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[9867]: audit 2021-01-28T04:07:41.411537+0000 mon.a (mon.0) 269 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]': finished 2021-01-28T04:07:43.582 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[9867]: cluster 2021-01-28T04:07:41.411693+0000 mon.a (mon.0) 270 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-28T04:07:43.582 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[9867]: audit 2021-01-28T04:07:41.411906+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:07:43.583 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[13629]: cluster 2021-01-28T04:07:40.792278+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:43.583 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[13629]: audit 2021-01-28T04:07:41.399716+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.150:0/354449214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]: dispatch 2021-01-28T04:07:43.584 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[13629]: audit 2021-01-28T04:07:41.400244+0000 mon.a (mon.0) 268 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]: dispatch 2021-01-28T04:07:43.584 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[13629]: audit 2021-01-28T04:07:41.411537+0000 mon.a (mon.0) 269 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]': finished 2021-01-28T04:07:43.585 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[13629]: cluster 2021-01-28T04:07:41.411693+0000 mon.a (mon.0) 270 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-28T04:07:43.585 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:41 smithi150 bash[13629]: audit 2021-01-28T04:07:41.411906+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:07:43.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:41 smithi134 bash[9858]: cluster 2021-01-28T04:07:40.792278+0000 mgr.y (mgr.14138) 103 : cluster [DBG] pgmap v72: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:43.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:41 smithi134 bash[9858]: audit 2021-01-28T04:07:41.399716+0000 mon.c (mon.1) 7 : audit [INF] from='client.? 172.21.15.150:0/354449214' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]: dispatch 2021-01-28T04:07:43.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:41 smithi134 bash[9858]: audit 2021-01-28T04:07:41.400244+0000 mon.a (mon.0) 268 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]: dispatch 2021-01-28T04:07:43.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:41 smithi134 bash[9858]: audit 2021-01-28T04:07:41.411537+0000 mon.a (mon.0) 269 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9d3c3014-f0c7-4677-aaec-847874e216d0"}]': finished 2021-01-28T04:07:43.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:41 smithi134 bash[9858]: cluster 2021-01-28T04:07:41.411693+0000 mon.a (mon.0) 270 : cluster [DBG] osdmap e13: 2 total, 1 up, 1 in 2021-01-28T04:07:43.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:41 smithi134 bash[9858]: audit 2021-01-28T04:07:41.411906+0000 mon.a (mon.0) 271 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:07:43.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:42 smithi134 bash[9858]: audit 2021-01-28T04:07:42.080226+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.150:0/1342583583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:07:43.590 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:42 smithi150 bash[9867]: audit 2021-01-28T04:07:42.080226+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.150:0/1342583583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:07:43.590 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:42 smithi150 bash[13629]: audit 2021-01-28T04:07:42.080226+0000 mon.c (mon.1) 8 : audit [DBG] from='client.? 172.21.15.150:0/1342583583' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:07:44.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:43 smithi150 bash[9867]: cluster 2021-01-28T04:07:42.792873+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:44.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:43 smithi150 bash[13629]: cluster 2021-01-28T04:07:42.792873+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:44.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:43 smithi134 bash[9858]: cluster 2021-01-28T04:07:42.792873+0000 mgr.y (mgr.14138) 104 : cluster [DBG] pgmap v74: 1 pgs: 1 creating+peering; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:44.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:44 smithi150 bash[9867]: cluster 2021-01-28T04:07:44.793598+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:44.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:44 smithi150 bash[13629]: cluster 2021-01-28T04:07:44.793598+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:45.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:44 smithi134 bash[9858]: cluster 2021-01-28T04:07:44.793598+0000 mgr.y (mgr.14138) 105 : cluster [DBG] pgmap v75: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:46.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:45 smithi150 bash[9867]: cluster 2021-01-28T04:07:44.925102+0000 mon.a (mon.0) 272 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T04:07:46.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:45 smithi150 bash[9867]: audit 2021-01-28T04:07:45.359829+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:46.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:45 smithi150 bash[13629]: cluster 2021-01-28T04:07:44.925102+0000 mon.a (mon.0) 272 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T04:07:46.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:45 smithi150 bash[13629]: audit 2021-01-28T04:07:45.359829+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:46.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:45 smithi134 bash[9858]: cluster 2021-01-28T04:07:44.925102+0000 mon.a (mon.0) 272 : cluster [WRN] Health check update: Reduced data availability: 1 pg inactive (PG_AVAILABILITY) 2021-01-28T04:07:46.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:45 smithi134 bash[9858]: audit 2021-01-28T04:07:45.359829+0000 mon.a (mon.0) 273 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:47.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:47 smithi134 bash[9858]: cluster 2021-01-28T04:07:46.794335+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:47.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:47 smithi150 bash[9867]: cluster 2021-01-28T04:07:46.794335+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:47.970 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:47 smithi150 bash[13629]: cluster 2021-01-28T04:07:46.794335+0000 mgr.y (mgr.14138) 106 : cluster [DBG] pgmap v76: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:50.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:49 smithi134 bash[9858]: cluster 2021-01-28T04:07:48.794800+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:50.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:49 smithi150 bash[9867]: cluster 2021-01-28T04:07:48.794800+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:50.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:49 smithi150 bash[13629]: cluster 2021-01-28T04:07:48.794800+0000 mgr.y (mgr.14138) 107 : cluster [DBG] pgmap v77: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:51.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:50 smithi134 bash[9858]: audit 2021-01-28T04:07:50.007410+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-28T04:07:51.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:50 smithi134 bash[9858]: audit 2021-01-28T04:07:50.008769+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:51.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:50 smithi134 bash[9858]: audit 2021-01-28T04:07:50.010304+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-28T04:07:51.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:50 smithi150 bash[9867]: audit 2021-01-28T04:07:50.007410+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-28T04:07:51.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:50 smithi150 bash[9867]: audit 2021-01-28T04:07:50.008769+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:51.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:50 smithi150 bash[9867]: audit 2021-01-28T04:07:50.010304+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-28T04:07:51.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:50 smithi150 bash[13629]: audit 2021-01-28T04:07:50.007410+0000 mon.a (mon.0) 274 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2021-01-28T04:07:51.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:50 smithi150 bash[13629]: audit 2021-01-28T04:07:50.008769+0000 mon.a (mon.0) 275 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:07:51.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:50 smithi150 bash[13629]: audit 2021-01-28T04:07:50.010304+0000 mon.a (mon.0) 276 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.1", "key": "container_image"}]: dispatch 2021-01-28T04:07:51.970 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:51 smithi150 bash[13629]: cephadm 2021-01-28T04:07:50.009757+0000 mgr.y (mgr.14138) 108 : cephadm [INF] Deploying daemon osd.1 on smithi150 2021-01-28T04:07:51.970 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:51 smithi150 bash[13629]: cluster 2021-01-28T04:07:50.795356+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:51.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:51 smithi150 bash[9867]: cephadm 2021-01-28T04:07:50.009757+0000 mgr.y (mgr.14138) 108 : cephadm [INF] Deploying daemon osd.1 on smithi150 2021-01-28T04:07:51.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:51 smithi150 bash[9867]: cluster 2021-01-28T04:07:50.795356+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:52.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:51 smithi134 bash[9858]: cephadm 2021-01-28T04:07:50.009757+0000 mgr.y (mgr.14138) 108 : cephadm [INF] Deploying daemon osd.1 on smithi150 2021-01-28T04:07:52.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:51 smithi134 bash[9858]: cluster 2021-01-28T04:07:50.795356+0000 mgr.y (mgr.14138) 109 : cluster [DBG] pgmap v78: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:52.819 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 1 on host 'smithi150' 2021-01-28T04:07:52.898 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:52 smithi150 bash[9867]: audit 2021-01-28T04:07:52.815992+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:52.898 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:52 smithi150 bash[9867]: audit 2021-01-28T04:07:52.820308+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:52.899 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:52 smithi150 bash[13629]: audit 2021-01-28T04:07:52.815992+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:52.899 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:52 smithi150 bash[13629]: audit 2021-01-28T04:07:52.820308+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:53.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:52 smithi134 bash[9858]: audit 2021-01-28T04:07:52.815992+0000 mon.a (mon.0) 277 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:07:53.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:52 smithi134 bash[9858]: audit 2021-01-28T04:07:52.820308+0000 mon.a (mon.0) 278 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:54.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:53 smithi134 bash[9858]: cluster 2021-01-28T04:07:52.795785+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:54.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:53 smithi134 bash[9858]: audit 2021-01-28T04:07:53.814936+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:54.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:53 smithi134 bash[9858]: audit 2021-01-28T04:07:53.816243+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:54.175 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:53 smithi150 bash[9867]: cluster 2021-01-28T04:07:52.795785+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:54.175 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:53 smithi150 bash[9867]: audit 2021-01-28T04:07:53.814936+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:54.175 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:53 smithi150 bash[9867]: audit 2021-01-28T04:07:53.816243+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:54.175 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:53 smithi150 bash[13629]: cluster 2021-01-28T04:07:52.795785+0000 mgr.y (mgr.14138) 110 : cluster [DBG] pgmap v79: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:54.176 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:53 smithi150 bash[13629]: audit 2021-01-28T04:07:53.814936+0000 mon.a (mon.0) 279 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:07:54.176 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:53 smithi150 bash[13629]: audit 2021-01-28T04:07:53.816243+0000 mon.a (mon.0) 280 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:07:54.177 DEBUG:teuthology.orchestra.run.smithi150:osd.1> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@osd.1.service 2021-01-28T04:07:54.182 INFO:tasks.cephadm:Deploying osd.2 on smithi150 with /dev/vg_nvme/lv_2... 2021-01-28T04:07:54.183 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-28T04:07:54.282 INFO:journalctl@ceph.osd.1.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:07:55.720 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[18871]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-28T04:07:55.720 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[18871]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2021-01-28T04:07:55.720 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[18871]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2021-01-28T04:07:55.721 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[18871]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2021-01-28T04:07:55.721 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[18871]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-28T04:07:55.721 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[18871]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2021-01-28T04:07:55.721 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[18871]: --> ceph-volume lvm activate successful for osd ID: 1 2021-01-28T04:07:56.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:55 smithi134 bash[9858]: cluster 2021-01-28T04:07:54.796378+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:56.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[9867]: cluster 2021-01-28T04:07:54.796378+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:56.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:55 smithi150 bash[13629]: cluster 2021-01-28T04:07:54.796378+0000 mgr.y (mgr.14138) 111 : cluster [DBG] pgmap v80: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:57.807 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:57 smithi150 bash[9867]: cluster 2021-01-28T04:07:56.796943+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:57.808 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:57 smithi150 bash[13629]: cluster 2021-01-28T04:07:56.796943+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:57.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:57 smithi134 bash[9858]: cluster 2021-01-28T04:07:56.796943+0000 mgr.y (mgr.14138) 112 : cluster [DBG] pgmap v81: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:07:59.849 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a62c07700 10 -- 172.21.15.150:0/106633566 dispatch_throttle_release 413 to dispatch throttler 413/104857600 2021-01-28T04:07:59.850 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a62c07700 20 -- 172.21.15.150:0/106633566 done calling dispatch on 0x557883288c60 2021-01-28T04:07:59.850 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 -- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 msgr2=0x55788327d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T04:07:59.851 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 -- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 msgr2=0x55788327d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T04:07:59.851 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).handle_read_frame_preamble_main r=0 2021-01-28T04:07:59.851 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_MESSAGE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).throttle_message 2021-01-28T04:07:59.851 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_BYTES pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).throttle_bytes 2021-01-28T04:07:59.852 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).throttle_dispatch_queue 2021-01-28T04:07:59.852 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).read_frame_segment seg_idx=0 2021-01-28T04:07:59.852 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).read_frame_segment seg_idx=1 2021-01-28T04:07:59.852 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 -- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 msgr2=0x55788327d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T04:07:59.853 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).handle_read_frame_segment r=0 2021-01-28T04:07:59.853 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 -- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 msgr2=0x55788327d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T04:07:59.853 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).handle_read_frame_epilogue_main r=0 2021-01-28T04:07:59.853 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 10 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).handle_read_frame_dispatch tag=17 2021-01-28T04:07:59.853 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).handle_message 2021-01-28T04:07:59.854 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 5 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.1 off 0 2021-01-28T04:07:59.854 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 5 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).handle_message received message m=0x5578832924e0 seq=4 from=mon.1 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T04:07:59.854 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 -- 172.21.15.150:0/106633566 queue 0x5578832924e0 prio 196 2021-01-28T04:07:59.854 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 --2- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 0x55788327d400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x55788328dec0 tx=0x5578832c2d80).read_frame 2021-01-28T04:07:59.854 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a63c09700 20 -- 172.21.15.150:0/106633566 >> [v2:172.21.15.150:3301/0,v1:172.21.15.150:6790/0] conn(0x557883310c00 msgr2=0x55788327d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T04:07:59.855 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[19165]: debug 2021-01-28T04:07:59.595+0000 7f0a62c07700 1 -- 172.21.15.150:0/106633566 <== mon.1 v2:172.21.15.150:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5578832924e0 con 0x557883310c00 2021-01-28T04:08:00.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:07:59 smithi134 bash[9858]: cluster 2021-01-28T04:07:58.797572+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:00.243 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[9867]: cluster 2021-01-28T04:07:58.797572+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:00.244 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:07:59 smithi150 bash[13629]: cluster 2021-01-28T04:07:58.797572+0000 mgr.y (mgr.14138) 113 : cluster [DBG] pgmap v82: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:00.534 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:08:00 smithi150 bash[19165]: debug 2021-01-28T04:08:00.239+0000 7f0a6a692200 -1 Falling back to public interface 2021-01-28T04:08:01.254 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-28T04:08:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-28T04:08:01.255 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2021-01-28T04:08:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2021-01-28T04:08:01.255 INFO:teuthology.orchestra.run.smithi150.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0164199 s, 639 MB/s 2021-01-28T04:08:01.256 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2021-01-28T04:08:02.136 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:01 smithi150 bash[9867]: cluster 2021-01-28T04:08:00.798118+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:02.137 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:01 smithi150 bash[13629]: cluster 2021-01-28T04:08:00.798118+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:02.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:01 smithi134 bash[9858]: cluster 2021-01-28T04:08:00.798118+0000 mgr.y (mgr.14138) 114 : cluster [DBG] pgmap v83: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:02.247 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi150:vg_nvme/lv_2 2021-01-28T04:08:03.641 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[19165]: debug 2021-01-28T04:08:03.303+0000 7f0a6a692200 -1 osd.1 0 log_to_monitors {default=true} 2021-01-28T04:08:03.936 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[9867]: cluster 2021-01-28T04:08:02.798737+0000 mgr.y (mgr.14138) 115 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:03.936 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[9867]: audit 2021-01-28T04:08:03.074252+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:03.936 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[9867]: audit 2021-01-28T04:08:03.312051+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-28T04:08:03.937 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[9867]: audit 2021-01-28T04:08:03.433828+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:03.937 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[13629]: cluster 2021-01-28T04:08:02.798737+0000 mgr.y (mgr.14138) 115 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:03.937 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[13629]: audit 2021-01-28T04:08:03.074252+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:03.937 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[13629]: audit 2021-01-28T04:08:03.312051+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-28T04:08:03.938 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:03 smithi150 bash[13629]: audit 2021-01-28T04:08:03.433828+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:04.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:03 smithi134 bash[9858]: cluster 2021-01-28T04:08:02.798737+0000 mgr.y (mgr.14138) 115 : cluster [DBG] pgmap v84: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:04.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:03 smithi134 bash[9858]: audit 2021-01-28T04:08:03.074252+0000 mon.a (mon.0) 281 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:04.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:03 smithi134 bash[9858]: audit 2021-01-28T04:08:03.312051+0000 mon.a (mon.0) 282 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2021-01-28T04:08:04.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:03 smithi134 bash[9858]: audit 2021-01-28T04:08:03.433828+0000 mon.a (mon.0) 283 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:05.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: cephadm 2021-01-28T04:08:03.434797+0000 mgr.y (mgr.14138) 116 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:08:05.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: audit 2021-01-28T04:08:03.867570+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:05.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: cephadm 2021-01-28T04:08:03.868972+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:05.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: audit 2021-01-28T04:08:03.877805+0000 mon.a (mon.0) 285 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-28T04:08:05.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: cluster 2021-01-28T04:08:03.877967+0000 mon.a (mon.0) 286 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-28T04:08:05.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: audit 2021-01-28T04:08:03.879185+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:05.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: audit 2021-01-28T04:08:03.879484+0000 mon.a (mon.0) 288 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:05.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: audit 2021-01-28T04:08:03.881554+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:05.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:04 smithi134 bash[9858]: cephadm 2021-01-28T04:08:03.882441+0000 mgr.y (mgr.14138) 118 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:05.220 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[19165]: debug 2021-01-28T04:08:04.887+0000 7f0a60c03700 -1 osd.1 0 waiting for initial osdmap 2021-01-28T04:08:05.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: cephadm 2021-01-28T04:08:03.434797+0000 mgr.y (mgr.14138) 116 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:08:05.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: audit 2021-01-28T04:08:03.867570+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:05.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: cephadm 2021-01-28T04:08:03.868972+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:05.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: audit 2021-01-28T04:08:03.877805+0000 mon.a (mon.0) 285 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-28T04:08:05.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: cluster 2021-01-28T04:08:03.877967+0000 mon.a (mon.0) 286 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-28T04:08:05.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: audit 2021-01-28T04:08:03.879185+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:05.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: audit 2021-01-28T04:08:03.879484+0000 mon.a (mon.0) 288 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:05.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: audit 2021-01-28T04:08:03.881554+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:05.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[13629]: cephadm 2021-01-28T04:08:03.882441+0000 mgr.y (mgr.14138) 118 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:05.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: cephadm 2021-01-28T04:08:03.434797+0000 mgr.y (mgr.14138) 116 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:08:05.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: audit 2021-01-28T04:08:03.867570+0000 mon.a (mon.0) 284 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:05.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: cephadm 2021-01-28T04:08:03.868972+0000 mgr.y (mgr.14138) 117 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:05.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: audit 2021-01-28T04:08:03.877805+0000 mon.a (mon.0) 285 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2021-01-28T04:08:05.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: cluster 2021-01-28T04:08:03.877967+0000 mon.a (mon.0) 286 : cluster [DBG] osdmap e14: 2 total, 1 up, 1 in 2021-01-28T04:08:05.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: audit 2021-01-28T04:08:03.879185+0000 mon.a (mon.0) 287 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:05.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: audit 2021-01-28T04:08:03.879484+0000 mon.a (mon.0) 288 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:05.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: audit 2021-01-28T04:08:03.881554+0000 mon.a (mon.0) 289 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:05.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:04 smithi150 bash[9867]: cephadm 2021-01-28T04:08:03.882441+0000 mgr.y (mgr.14138) 118 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:06.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: cluster 2021-01-28T04:08:04.799277+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:06.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: audit 2021-01-28T04:08:04.879926+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:08:06.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: cluster 2021-01-28T04:08:04.880160+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-28T04:08:06.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: audit 2021-01-28T04:08:04.881229+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:06.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: audit 2021-01-28T04:08:04.893446+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:06.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: audit 2021-01-28T04:08:05.738097+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:08:06.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: audit 2021-01-28T04:08:05.740588+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:08:06.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: audit 2021-01-28T04:08:05.742120+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:06.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:05 smithi134 bash[9858]: audit 2021-01-28T04:08:05.743951+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:06.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: cluster 2021-01-28T04:08:04.799277+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:06.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: audit 2021-01-28T04:08:04.879926+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:08:06.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: cluster 2021-01-28T04:08:04.880160+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-28T04:08:06.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: audit 2021-01-28T04:08:04.881229+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:06.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: audit 2021-01-28T04:08:04.893446+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:06.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: audit 2021-01-28T04:08:05.738097+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:08:06.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: audit 2021-01-28T04:08:05.740588+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:08:06.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: audit 2021-01-28T04:08:05.742120+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:06.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[9867]: audit 2021-01-28T04:08:05.743951+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:06.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: cluster 2021-01-28T04:08:04.799277+0000 mgr.y (mgr.14138) 119 : cluster [DBG] pgmap v86: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:06.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: audit 2021-01-28T04:08:04.879926+0000 mon.a (mon.0) 290 : audit [INF] from='osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:08:06.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: cluster 2021-01-28T04:08:04.880160+0000 mon.a (mon.0) 291 : cluster [DBG] osdmap e15: 2 total, 1 up, 1 in 2021-01-28T04:08:06.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: audit 2021-01-28T04:08:04.881229+0000 mon.a (mon.0) 292 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:06.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: audit 2021-01-28T04:08:04.893446+0000 mon.a (mon.0) 293 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:06.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: audit 2021-01-28T04:08:05.738097+0000 mon.a (mon.0) 294 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:08:06.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: audit 2021-01-28T04:08:05.740588+0000 mon.a (mon.0) 295 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:08:06.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: audit 2021-01-28T04:08:05.742120+0000 mon.a (mon.0) 296 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:06.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:05 smithi150 bash[13629]: audit 2021-01-28T04:08:05.743951+0000 mon.a (mon.0) 297 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:07.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:06 smithi134 bash[9858]: cluster 2021-01-28T04:08:04.329689+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:08:07.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:06 smithi134 bash[9858]: cluster 2021-01-28T04:08:04.329922+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:08:07.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:06 smithi134 bash[9858]: audit 2021-01-28T04:08:05.736723+0000 mgr.y (mgr.14138) 120 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:08:07.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:06 smithi134 bash[9858]: cephadm 2021-01-28T04:08:05.740080+0000 mgr.y (mgr.14138) 121 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:08:07.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:06 smithi134 bash[9858]: audit 2021-01-28T04:08:05.892459+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:07.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:06 smithi134 bash[9858]: cluster 2021-01-28T04:08:05.897015+0000 mon.a (mon.0) 299 : cluster [INF] osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724] boot 2021-01-28T04:08:07.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:06 smithi134 bash[9858]: cluster 2021-01-28T04:08:05.897086+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-28T04:08:07.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:06 smithi134 bash[9858]: audit 2021-01-28T04:08:05.897720+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:07.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[9867]: cluster 2021-01-28T04:08:04.329689+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:08:07.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[9867]: cluster 2021-01-28T04:08:04.329922+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:08:07.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[9867]: audit 2021-01-28T04:08:05.736723+0000 mgr.y (mgr.14138) 120 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:08:07.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[9867]: cephadm 2021-01-28T04:08:05.740080+0000 mgr.y (mgr.14138) 121 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:08:07.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[9867]: audit 2021-01-28T04:08:05.892459+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:07.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[9867]: cluster 2021-01-28T04:08:05.897015+0000 mon.a (mon.0) 299 : cluster [INF] osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724] boot 2021-01-28T04:08:07.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[9867]: cluster 2021-01-28T04:08:05.897086+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-28T04:08:07.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[9867]: audit 2021-01-28T04:08:05.897720+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:07.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[13629]: cluster 2021-01-28T04:08:04.329689+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:08:07.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[13629]: cluster 2021-01-28T04:08:04.329922+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:08:07.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[13629]: audit 2021-01-28T04:08:05.736723+0000 mgr.y (mgr.14138) 120 : audit [DBG] from='client.24175 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:08:07.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[13629]: cephadm 2021-01-28T04:08:05.740080+0000 mgr.y (mgr.14138) 121 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:08:07.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[13629]: audit 2021-01-28T04:08:05.892459+0000 mon.a (mon.0) 298 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:07.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[13629]: cluster 2021-01-28T04:08:05.897015+0000 mon.a (mon.0) 299 : cluster [INF] osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724] boot 2021-01-28T04:08:07.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[13629]: cluster 2021-01-28T04:08:05.897086+0000 mon.a (mon.0) 300 : cluster [DBG] osdmap e16: 2 total, 2 up, 2 in 2021-01-28T04:08:07.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:06 smithi150 bash[13629]: audit 2021-01-28T04:08:05.897720+0000 mon.a (mon.0) 301 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:08:08.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:07 smithi150 bash[9867]: cluster 2021-01-28T04:08:06.799877+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v89: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:08.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:07 smithi150 bash[9867]: cluster 2021-01-28T04:08:06.901367+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-28T04:08:08.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:07 smithi150 bash[13629]: cluster 2021-01-28T04:08:06.799877+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v89: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:08.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:07 smithi150 bash[13629]: cluster 2021-01-28T04:08:06.901367+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-28T04:08:08.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:07 smithi134 bash[9858]: cluster 2021-01-28T04:08:06.799877+0000 mgr.y (mgr.14138) 122 : cluster [DBG] pgmap v89: 1 pgs: 1 undersized+peered; 0 B data, 4.7 MiB used, 89 GiB / 89 GiB avail 2021-01-28T04:08:08.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:07 smithi134 bash[9858]: cluster 2021-01-28T04:08:06.901367+0000 mon.a (mon.0) 302 : cluster [DBG] osdmap e17: 2 total, 2 up, 2 in 2021-01-28T04:08:10.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:09 smithi150 bash[9867]: cluster 2021-01-28T04:08:08.800516+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:10.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:09 smithi150 bash[13629]: cluster 2021-01-28T04:08:08.800516+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:10.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:09 smithi134 bash[9858]: cluster 2021-01-28T04:08:08.800516+0000 mgr.y (mgr.14138) 123 : cluster [DBG] pgmap v91: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:11.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[9867]: audit 2021-01-28T04:08:10.211354+0000 mon.a (mon.0) 303 : audit [INF] from='client.? 172.21.15.150:0/1719882534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ad36a92-9bcf-44fa-8132-698ca0c8f0e7"}]: dispatch 2021-01-28T04:08:11.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[9867]: audit 2021-01-28T04:08:10.218652+0000 mon.a (mon.0) 304 : audit [INF] from='client.? 172.21.15.150:0/1719882534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ad36a92-9bcf-44fa-8132-698ca0c8f0e7"}]': finished 2021-01-28T04:08:11.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[9867]: cluster 2021-01-28T04:08:10.218789+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-28T04:08:11.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[9867]: audit 2021-01-28T04:08:10.219054+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:11.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[9867]: audit 2021-01-28T04:08:10.857338+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.150:0/2068295637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:08:11.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[13629]: audit 2021-01-28T04:08:10.211354+0000 mon.a (mon.0) 303 : audit [INF] from='client.? 172.21.15.150:0/1719882534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ad36a92-9bcf-44fa-8132-698ca0c8f0e7"}]: dispatch 2021-01-28T04:08:11.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[13629]: audit 2021-01-28T04:08:10.218652+0000 mon.a (mon.0) 304 : audit [INF] from='client.? 172.21.15.150:0/1719882534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ad36a92-9bcf-44fa-8132-698ca0c8f0e7"}]': finished 2021-01-28T04:08:11.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[13629]: cluster 2021-01-28T04:08:10.218789+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-28T04:08:11.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[13629]: audit 2021-01-28T04:08:10.219054+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:11.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:10 smithi150 bash[13629]: audit 2021-01-28T04:08:10.857338+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.150:0/2068295637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:08:11.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:10 smithi134 bash[9858]: audit 2021-01-28T04:08:10.211354+0000 mon.a (mon.0) 303 : audit [INF] from='client.? 172.21.15.150:0/1719882534' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8ad36a92-9bcf-44fa-8132-698ca0c8f0e7"}]: dispatch 2021-01-28T04:08:11.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:10 smithi134 bash[9858]: audit 2021-01-28T04:08:10.218652+0000 mon.a (mon.0) 304 : audit [INF] from='client.? 172.21.15.150:0/1719882534' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8ad36a92-9bcf-44fa-8132-698ca0c8f0e7"}]': finished 2021-01-28T04:08:11.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:10 smithi134 bash[9858]: cluster 2021-01-28T04:08:10.218789+0000 mon.a (mon.0) 305 : cluster [DBG] osdmap e18: 3 total, 2 up, 2 in 2021-01-28T04:08:11.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:10 smithi134 bash[9858]: audit 2021-01-28T04:08:10.219054+0000 mon.a (mon.0) 306 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:11.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:10 smithi134 bash[9858]: audit 2021-01-28T04:08:10.857338+0000 mon.c (mon.1) 9 : audit [DBG] from='client.? 172.21.15.150:0/2068295637' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:08:12.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:11 smithi150 bash[9867]: cluster 2021-01-28T04:08:10.800961+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:12.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:11 smithi150 bash[13629]: cluster 2021-01-28T04:08:10.800961+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:12.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:11 smithi134 bash[9858]: cluster 2021-01-28T04:08:10.800961+0000 mgr.y (mgr.14138) 124 : cluster [DBG] pgmap v93: 1 pgs: 1 undersized+peered; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:13.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:12 smithi150 bash[13629]: cluster 2021-01-28T04:08:12.801531+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:13.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:12 smithi150 bash[13629]: cluster 2021-01-28T04:08:12.909462+0000 mon.a (mon.0) 307 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-28T04:08:13.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:12 smithi150 bash[13629]: cluster 2021-01-28T04:08:12.909529+0000 mon.a (mon.0) 308 : cluster [INF] Cluster is now healthy 2021-01-28T04:08:13.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:12 smithi150 bash[9867]: cluster 2021-01-28T04:08:12.801531+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:13.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:12 smithi150 bash[9867]: cluster 2021-01-28T04:08:12.909462+0000 mon.a (mon.0) 307 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-28T04:08:13.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:12 smithi150 bash[9867]: cluster 2021-01-28T04:08:12.909529+0000 mon.a (mon.0) 308 : cluster [INF] Cluster is now healthy 2021-01-28T04:08:13.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:12 smithi134 bash[9858]: cluster 2021-01-28T04:08:12.801531+0000 mgr.y (mgr.14138) 125 : cluster [DBG] pgmap v94: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:13.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:12 smithi134 bash[9858]: cluster 2021-01-28T04:08:12.909462+0000 mon.a (mon.0) 307 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg inactive) 2021-01-28T04:08:13.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:12 smithi134 bash[9858]: cluster 2021-01-28T04:08:12.909529+0000 mon.a (mon.0) 308 : cluster [INF] Cluster is now healthy 2021-01-28T04:08:14.469 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:14 smithi150 bash[9867]: audit 2021-01-28T04:08:14.123187+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:14.470 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:14 smithi150 bash[13629]: audit 2021-01-28T04:08:14.123187+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:14.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:14 smithi134 bash[9858]: audit 2021-01-28T04:08:14.123187+0000 mon.a (mon.0) 309 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:15.448 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:15 smithi150 bash[9867]: cluster 2021-01-28T04:08:14.802078+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:15.449 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:15 smithi150 bash[13629]: cluster 2021-01-28T04:08:14.802078+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:15.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:15 smithi134 bash[9858]: cluster 2021-01-28T04:08:14.802078+0000 mgr.y (mgr.14138) 126 : cluster [DBG] pgmap v95: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:17.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:17 smithi150 bash[9867]: cluster 2021-01-28T04:08:16.802626+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:17.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:17 smithi150 bash[13629]: cluster 2021-01-28T04:08:16.802626+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:17.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:17 smithi134 bash[9858]: cluster 2021-01-28T04:08:16.802626+0000 mgr.y (mgr.14138) 127 : cluster [DBG] pgmap v96: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:19.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:18 smithi134 bash[9858]: audit 2021-01-28T04:08:18.821637+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-28T04:08:19.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:18 smithi134 bash[9858]: audit 2021-01-28T04:08:18.823249+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:19.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:18 smithi134 bash[9858]: audit 2021-01-28T04:08:18.825264+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-28T04:08:19.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:18 smithi150 bash[9867]: audit 2021-01-28T04:08:18.821637+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-28T04:08:19.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:18 smithi150 bash[9867]: audit 2021-01-28T04:08:18.823249+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:19.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:18 smithi150 bash[9867]: audit 2021-01-28T04:08:18.825264+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-28T04:08:19.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:18 smithi150 bash[13629]: audit 2021-01-28T04:08:18.821637+0000 mon.a (mon.0) 310 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2021-01-28T04:08:19.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:18 smithi150 bash[13629]: audit 2021-01-28T04:08:18.823249+0000 mon.a (mon.0) 311 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:19.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:18 smithi150 bash[13629]: audit 2021-01-28T04:08:18.825264+0000 mon.a (mon.0) 312 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.2", "key": "container_image"}]: dispatch 2021-01-28T04:08:20.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:19 smithi134 bash[9858]: cluster 2021-01-28T04:08:18.803257+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:20.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:19 smithi134 bash[9858]: cephadm 2021-01-28T04:08:18.824408+0000 mgr.y (mgr.14138) 129 : cephadm [INF] Deploying daemon osd.2 on smithi150 2021-01-28T04:08:20.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:19 smithi150 bash[9867]: cluster 2021-01-28T04:08:18.803257+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:20.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:19 smithi150 bash[9867]: cephadm 2021-01-28T04:08:18.824408+0000 mgr.y (mgr.14138) 129 : cephadm [INF] Deploying daemon osd.2 on smithi150 2021-01-28T04:08:20.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:19 smithi150 bash[13629]: cluster 2021-01-28T04:08:18.803257+0000 mgr.y (mgr.14138) 128 : cluster [DBG] pgmap v97: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:20.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:19 smithi150 bash[13629]: cephadm 2021-01-28T04:08:18.824408+0000 mgr.y (mgr.14138) 129 : cephadm [INF] Deploying daemon osd.2 on smithi150 2021-01-28T04:08:20.969 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:08:20 smithi150 bash[10146]: debug 2021-01-28T04:08:20.775+0000 7fb3aac00700 -1 calc_pg_upmaps abort due to max <= 0 2021-01-28T04:08:21.748 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 2 on host 'smithi150' 2021-01-28T04:08:22.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:21 smithi134 bash[9858]: cluster 2021-01-28T04:08:20.803847+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:21 smithi134 bash[9858]: audit 2021-01-28T04:08:20.937919+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:08:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:21 smithi134 bash[9858]: audit 2021-01-28T04:08:20.947325+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:08:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:21 smithi134 bash[9858]: audit 2021-01-28T04:08:21.747458+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:21 smithi134 bash[9858]: audit 2021-01-28T04:08:21.752126+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:22.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[9867]: cluster 2021-01-28T04:08:20.803847+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:22.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[9867]: audit 2021-01-28T04:08:20.937919+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:08:22.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[9867]: audit 2021-01-28T04:08:20.947325+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:08:22.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[9867]: audit 2021-01-28T04:08:21.747458+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:22.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[9867]: audit 2021-01-28T04:08:21.752126+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:22.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[13629]: cluster 2021-01-28T04:08:20.803847+0000 mgr.y (mgr.14138) 130 : cluster [DBG] pgmap v98: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:22.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[13629]: audit 2021-01-28T04:08:20.937919+0000 mon.a (mon.0) 313 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:08:22.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[13629]: audit 2021-01-28T04:08:20.947325+0000 mon.a (mon.0) 314 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:08:22.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[13629]: audit 2021-01-28T04:08:21.747458+0000 mon.a (mon.0) 315 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:22.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:21 smithi150 bash[13629]: audit 2021-01-28T04:08:21.752126+0000 mon.a (mon.0) 316 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:23.419 DEBUG:teuthology.orchestra.run.smithi150:osd.2> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@osd.2.service 2021-01-28T04:08:23.423 INFO:tasks.cephadm:Deploying osd.3 on smithi150 with /dev/vg_nvme/lv_1... 2021-01-28T04:08:23.423 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-28T04:08:23.687 INFO:journalctl@ceph.osd.2.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:08:23.872 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:23 smithi150 bash[13629]: cluster 2021-01-28T04:08:22.804491+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:23.872 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:23 smithi150 bash[13629]: audit 2021-01-28T04:08:22.873730+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:23.872 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:23 smithi150 bash[13629]: audit 2021-01-28T04:08:22.875192+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:23.873 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:23 smithi150 bash[9867]: cluster 2021-01-28T04:08:22.804491+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:23.873 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:23 smithi150 bash[9867]: audit 2021-01-28T04:08:22.873730+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:23.873 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:23 smithi150 bash[9867]: audit 2021-01-28T04:08:22.875192+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:24.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:23 smithi134 bash[9858]: cluster 2021-01-28T04:08:22.804491+0000 mgr.y (mgr.14138) 131 : cluster [DBG] pgmap v99: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:24.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:23 smithi134 bash[9858]: audit 2021-01-28T04:08:22.873730+0000 mon.a (mon.0) 317 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:24.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:23 smithi134 bash[9858]: audit 2021-01-28T04:08:22.875192+0000 mon.a (mon.0) 318 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:25.363 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:24 smithi150 bash[21377]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-28T04:08:25.364 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:24 smithi150 bash[21377]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2021-01-28T04:08:25.364 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:24 smithi150 bash[21377]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2021-01-28T04:08:25.364 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:24 smithi150 bash[21377]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2021-01-28T04:08:25.365 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:24 smithi150 bash[21377]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-28T04:08:25.365 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:24 smithi150 bash[21377]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2021-01-28T04:08:25.365 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:24 smithi150 bash[21377]: --> ceph-volume lvm activate successful for osd ID: 2 2021-01-28T04:08:26.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:25 smithi134 bash[9858]: cluster 2021-01-28T04:08:24.805158+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:26.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:25 smithi150 bash[9867]: cluster 2021-01-28T04:08:24.805158+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:26.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:25 smithi150 bash[13629]: cluster 2021-01-28T04:08:24.805158+0000 mgr.y (mgr.14138) 132 : cluster [DBG] pgmap v100: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:27.719 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:27 smithi150 bash[13629]: cluster 2021-01-28T04:08:26.805719+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:27.719 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:27 smithi150 bash[9867]: cluster 2021-01-28T04:08:26.805719+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:27.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:27 smithi134 bash[9858]: cluster 2021-01-28T04:08:26.805719+0000 mgr.y (mgr.14138) 133 : cluster [DBG] pgmap v101: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:30.079 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[9867]: cluster 2021-01-28T04:08:28.806139+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:30.080 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[13629]: cluster 2021-01-28T04:08:28.806139+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:30.080 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 -- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 msgr2=0x55de66301400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T04:08:30.081 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 -- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 msgr2=0x55de66301400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T04:08:30.081 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).handle_read_frame_preamble_main r=0 2021-01-28T04:08:30.081 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_MESSAGE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).throttle_message 2021-01-28T04:08:30.081 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_BYTES pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).throttle_bytes 2021-01-28T04:08:30.081 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).throttle_dispatch_queue 2021-01-28T04:08:30.082 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).read_frame_segment seg_idx=0 2021-01-28T04:08:30.082 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).read_frame_segment seg_idx=1 2021-01-28T04:08:30.082 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 -- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 msgr2=0x55de66301400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T04:08:30.082 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).handle_read_frame_segment r=0 2021-01-28T04:08:30.083 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 -- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 msgr2=0x55de66301400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T04:08:30.083 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).handle_read_frame_epilogue_main r=0 2021-01-28T04:08:30.083 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 10 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).handle_read_frame_dispatch tag=17 2021-01-28T04:08:30.083 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).handle_message 2021-01-28T04:08:30.085 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 5 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=THROTTLE_DONE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-28T04:08:30.085 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 5 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).handle_message received message m=0x55de663164e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T04:08:30.085 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 -- 172.21.15.150:0/3272868183 queue 0x55de663164e0 prio 196 2021-01-28T04:08:30.085 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 --2- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 0x55de66301400 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x55de66311e60 tx=0x55de663460c0).read_frame 2021-01-28T04:08:30.086 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5f65e700 20 -- 172.21.15.150:0/3272868183 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x55de66394c00 msgr2=0x55de66301400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T04:08:30.086 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5e65c700 1 -- 172.21.15.150:0/3272868183 <== mon.0 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55de663164e0 con 0x55de66394c00 2021-01-28T04:08:30.086 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5e65c700 10 -- 172.21.15.150:0/3272868183 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T04:08:30.086 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:29 smithi150 bash[21728]: debug 2021-01-28T04:08:29.879+0000 7fbb5e65c700 20 -- 172.21.15.150:0/3272868183 done calling dispatch on 0x55de663164e0 2021-01-28T04:08:30.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:29 smithi134 bash[9858]: cluster 2021-01-28T04:08:28.806139+0000 mgr.y (mgr.14138) 134 : cluster [DBG] pgmap v102: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:30.719 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:30 smithi150 bash[21728]: debug 2021-01-28T04:08:30.431+0000 7fbb660e7200 -1 Falling back to public interface 2021-01-28T04:08:30.995 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-28T04:08:30.997 INFO:teuthology.orchestra.run.smithi150.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-28T04:08:30.999 INFO:teuthology.orchestra.run.smithi150.stderr: stderr: 10+0 records in 2021-01-28T04:08:30.999 INFO:teuthology.orchestra.run.smithi150.stderr:10+0 records out 2021-01-28T04:08:30.999 INFO:teuthology.orchestra.run.smithi150.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0171063 s, 613 MB/s 2021-01-28T04:08:31.000 INFO:teuthology.orchestra.run.smithi150.stderr:--> Zapping successful for: 2021-01-28T04:08:31.982 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi150:vg_nvme/lv_1 2021-01-28T04:08:32.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:31 smithi134 bash[9858]: cluster 2021-01-28T04:08:30.806713+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:32.180 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:31 smithi150 bash[13629]: cluster 2021-01-28T04:08:30.806713+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:32.180 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:31 smithi150 bash[9867]: cluster 2021-01-28T04:08:30.806713+0000 mgr.y (mgr.14138) 135 : cluster [DBG] pgmap v103: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:33.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:32 smithi134 bash[9858]: audit 2021-01-28T04:08:32.856641+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:33.205 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:32 smithi150 bash[9867]: audit 2021-01-28T04:08:32.856641+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:33.205 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:32 smithi150 bash[13629]: audit 2021-01-28T04:08:32.856641+0000 mon.a (mon.0) 319 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:33.469 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[21728]: debug 2021-01-28T04:08:33.447+0000 7fbb660e7200 -1 osd.2 0 log_to_monitors {default=true} 2021-01-28T04:08:34.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:33 smithi134 bash[9858]: cluster 2021-01-28T04:08:32.807375+0000 mgr.y (mgr.14138) 136 : cluster [DBG] pgmap v104: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:34.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:33 smithi134 bash[9858]: audit 2021-01-28T04:08:33.227052+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:34.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:33 smithi134 bash[9858]: audit 2021-01-28T04:08:33.231969+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:34.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:33 smithi134 bash[9858]: audit 2021-01-28T04:08:33.457521+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T04:08:34.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:33 smithi134 bash[9858]: audit 2021-01-28T04:08:33.458050+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T04:08:34.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:33 smithi134 bash[9858]: audit 2021-01-28T04:08:33.640460+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:34.190 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[9867]: cluster 2021-01-28T04:08:32.807375+0000 mgr.y (mgr.14138) 136 : cluster [DBG] pgmap v104: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:34.190 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[9867]: audit 2021-01-28T04:08:33.227052+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:34.191 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[9867]: audit 2021-01-28T04:08:33.231969+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:34.191 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[9867]: audit 2021-01-28T04:08:33.457521+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T04:08:34.191 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[9867]: audit 2021-01-28T04:08:33.458050+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T04:08:34.191 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[9867]: audit 2021-01-28T04:08:33.640460+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:34.192 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[13629]: cluster 2021-01-28T04:08:32.807375+0000 mgr.y (mgr.14138) 136 : cluster [DBG] pgmap v104: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:34.192 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[13629]: audit 2021-01-28T04:08:33.227052+0000 mon.a (mon.0) 320 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:34.192 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[13629]: audit 2021-01-28T04:08:33.231969+0000 mon.a (mon.0) 321 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:34.192 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[13629]: audit 2021-01-28T04:08:33.457521+0000 mon.c (mon.1) 10 : audit [INF] from='osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T04:08:34.192 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[13629]: audit 2021-01-28T04:08:33.458050+0000 mon.a (mon.0) 322 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2021-01-28T04:08:34.193 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:33 smithi150 bash[13629]: audit 2021-01-28T04:08:33.640460+0000 mon.a (mon.0) 323 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:35.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:34 smithi134 bash[9858]: cephadm 2021-01-28T04:08:33.232839+0000 mgr.y (mgr.14138) 137 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:35.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:34 smithi134 bash[9858]: cephadm 2021-01-28T04:08:33.234400+0000 mgr.y (mgr.14138) 138 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:08:35.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:34 smithi134 bash[9858]: cephadm 2021-01-28T04:08:33.641908+0000 mgr.y (mgr.14138) 139 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:35.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:34 smithi134 bash[9858]: audit 2021-01-28T04:08:34.239043+0000 mon.a (mon.0) 324 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-28T04:08:35.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:34 smithi134 bash[9858]: cluster 2021-01-28T04:08:34.239143+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-28T04:08:35.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:34 smithi134 bash[9858]: audit 2021-01-28T04:08:34.239507+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:35.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:34 smithi134 bash[9858]: audit 2021-01-28T04:08:34.240627+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:35.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:34 smithi134 bash[9858]: audit 2021-01-28T04:08:34.241211+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:35.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[9867]: cephadm 2021-01-28T04:08:33.232839+0000 mgr.y (mgr.14138) 137 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:35.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[9867]: cephadm 2021-01-28T04:08:33.234400+0000 mgr.y (mgr.14138) 138 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:08:35.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[9867]: cephadm 2021-01-28T04:08:33.641908+0000 mgr.y (mgr.14138) 139 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:35.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[9867]: audit 2021-01-28T04:08:34.239043+0000 mon.a (mon.0) 324 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-28T04:08:35.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[9867]: cluster 2021-01-28T04:08:34.239143+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-28T04:08:35.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[9867]: audit 2021-01-28T04:08:34.239507+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:35.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[9867]: audit 2021-01-28T04:08:34.240627+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:35.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[9867]: audit 2021-01-28T04:08:34.241211+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:35.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[13629]: cephadm 2021-01-28T04:08:33.232839+0000 mgr.y (mgr.14138) 137 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:35.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[13629]: cephadm 2021-01-28T04:08:33.234400+0000 mgr.y (mgr.14138) 138 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:08:35.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[13629]: cephadm 2021-01-28T04:08:33.641908+0000 mgr.y (mgr.14138) 139 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:08:35.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[13629]: audit 2021-01-28T04:08:34.239043+0000 mon.a (mon.0) 324 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2021-01-28T04:08:35.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[13629]: cluster 2021-01-28T04:08:34.239143+0000 mon.a (mon.0) 325 : cluster [DBG] osdmap e19: 3 total, 2 up, 2 in 2021-01-28T04:08:35.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[13629]: audit 2021-01-28T04:08:34.239507+0000 mon.a (mon.0) 326 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:35.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[13629]: audit 2021-01-28T04:08:34.240627+0000 mon.c (mon.1) 11 : audit [INF] from='osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:35.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:34 smithi150 bash[13629]: audit 2021-01-28T04:08:34.241211+0000 mon.a (mon.0) 327 : audit [INF] from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:08:35.719 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[21728]: debug 2021-01-28T04:08:35.243+0000 7fbb5c658700 -1 osd.2 0 waiting for initial osdmap 2021-01-28T04:08:36.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: cluster 2021-01-28T04:08:34.807936+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v106: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:36.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: audit 2021-01-28T04:08:35.240639+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:08:36.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: cluster 2021-01-28T04:08:35.240830+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-28T04:08:36.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: audit 2021-01-28T04:08:35.241574+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:36.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: audit 2021-01-28T04:08:35.248784+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:36.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: audit 2021-01-28T04:08:35.654418+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:08:36.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: audit 2021-01-28T04:08:35.656965+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:08:36.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: audit 2021-01-28T04:08:35.658456+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:36.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:35 smithi134 bash[9858]: audit 2021-01-28T04:08:35.660283+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:36.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: cluster 2021-01-28T04:08:34.807936+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v106: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:36.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: audit 2021-01-28T04:08:35.240639+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:08:36.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: cluster 2021-01-28T04:08:35.240830+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-28T04:08:36.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: audit 2021-01-28T04:08:35.241574+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:36.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: audit 2021-01-28T04:08:35.248784+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:36.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: audit 2021-01-28T04:08:35.654418+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:08:36.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: audit 2021-01-28T04:08:35.656965+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:08:36.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: audit 2021-01-28T04:08:35.658456+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:36.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[9867]: audit 2021-01-28T04:08:35.660283+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:36.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: cluster 2021-01-28T04:08:34.807936+0000 mgr.y (mgr.14138) 140 : cluster [DBG] pgmap v106: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:36.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: audit 2021-01-28T04:08:35.240639+0000 mon.a (mon.0) 328 : audit [INF] from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:08:36.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: cluster 2021-01-28T04:08:35.240830+0000 mon.a (mon.0) 329 : cluster [DBG] osdmap e20: 3 total, 2 up, 2 in 2021-01-28T04:08:36.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: audit 2021-01-28T04:08:35.241574+0000 mon.a (mon.0) 330 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:36.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: audit 2021-01-28T04:08:35.248784+0000 mon.a (mon.0) 331 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:36.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: audit 2021-01-28T04:08:35.654418+0000 mon.a (mon.0) 332 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:08:36.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: audit 2021-01-28T04:08:35.656965+0000 mon.a (mon.0) 333 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:08:36.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: audit 2021-01-28T04:08:35.658456+0000 mon.a (mon.0) 334 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:36.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:35 smithi150 bash[13629]: audit 2021-01-28T04:08:35.660283+0000 mon.a (mon.0) 335 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:37.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:36 smithi134 bash[9858]: cluster 2021-01-28T04:08:34.491696+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:08:37.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:36 smithi134 bash[9858]: cluster 2021-01-28T04:08:34.491908+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:08:37.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:36 smithi134 bash[9858]: audit 2021-01-28T04:08:35.653154+0000 mgr.y (mgr.14138) 141 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:08:37.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:36 smithi134 bash[9858]: cephadm 2021-01-28T04:08:35.656476+0000 mgr.y (mgr.14138) 142 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:08:37.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:36 smithi134 bash[9858]: cluster 2021-01-28T04:08:36.252969+0000 mon.a (mon.0) 336 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:08:37.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:36 smithi134 bash[9858]: cluster 2021-01-28T04:08:36.253264+0000 mon.a (mon.0) 337 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-28T04:08:37.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:36 smithi134 bash[9858]: audit 2021-01-28T04:08:36.253592+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:37.148 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[9867]: cluster 2021-01-28T04:08:34.491696+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:08:37.149 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[9867]: cluster 2021-01-28T04:08:34.491908+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:08:37.149 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[9867]: audit 2021-01-28T04:08:35.653154+0000 mgr.y (mgr.14138) 141 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:08:37.149 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[9867]: cephadm 2021-01-28T04:08:35.656476+0000 mgr.y (mgr.14138) 142 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:08:37.150 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[9867]: cluster 2021-01-28T04:08:36.252969+0000 mon.a (mon.0) 336 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:08:37.150 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[9867]: cluster 2021-01-28T04:08:36.253264+0000 mon.a (mon.0) 337 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-28T04:08:37.150 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[9867]: audit 2021-01-28T04:08:36.253592+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:37.150 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[13629]: cluster 2021-01-28T04:08:34.491696+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:08:37.151 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[13629]: cluster 2021-01-28T04:08:34.491908+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:08:37.151 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[13629]: audit 2021-01-28T04:08:35.653154+0000 mgr.y (mgr.14138) 141 : audit [DBG] from='client.14280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi150:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:08:37.151 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[13629]: cephadm 2021-01-28T04:08:35.656476+0000 mgr.y (mgr.14138) 142 : cephadm [INF] Applying drive group None on host smithi150... 2021-01-28T04:08:37.151 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[13629]: cluster 2021-01-28T04:08:36.252969+0000 mon.a (mon.0) 336 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:08:37.152 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[13629]: cluster 2021-01-28T04:08:36.253264+0000 mon.a (mon.0) 337 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2021-01-28T04:08:37.152 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:36 smithi150 bash[13629]: audit 2021-01-28T04:08:36.253592+0000 mon.a (mon.0) 338 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:08:38.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:37 smithi134 bash[9858]: cluster 2021-01-28T04:08:36.808467+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v109: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:38.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:37 smithi134 bash[9858]: cluster 2021-01-28T04:08:37.256194+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-28T04:08:38.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:37 smithi150 bash[13629]: cluster 2021-01-28T04:08:36.808467+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v109: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:38.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:37 smithi150 bash[13629]: cluster 2021-01-28T04:08:37.256194+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-28T04:08:38.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:37 smithi150 bash[9867]: cluster 2021-01-28T04:08:36.808467+0000 mgr.y (mgr.14138) 143 : cluster [DBG] pgmap v109: 1 pgs: 1 active+undersized; 0 B data, 9.6 MiB used, 179 GiB / 179 GiB avail 2021-01-28T04:08:38.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:37 smithi150 bash[9867]: cluster 2021-01-28T04:08:37.256194+0000 mon.a (mon.0) 339 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2021-01-28T04:08:40.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[9867]: cluster 2021-01-28T04:08:38.809078+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v111: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:40.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[9867]: audit 2021-01-28T04:08:39.837468+0000 mon.a (mon.0) 340 : audit [INF] from='client.? 172.21.15.150:0/665966314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7"}]: dispatch 2021-01-28T04:08:40.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[9867]: audit 2021-01-28T04:08:39.847453+0000 mon.a (mon.0) 341 : audit [INF] from='client.? 172.21.15.150:0/665966314' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7"}]': finished 2021-01-28T04:08:40.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[9867]: cluster 2021-01-28T04:08:39.847571+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-28T04:08:40.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[9867]: audit 2021-01-28T04:08:39.847803+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:08:40.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[13629]: cluster 2021-01-28T04:08:38.809078+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v111: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:40.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[13629]: audit 2021-01-28T04:08:39.837468+0000 mon.a (mon.0) 340 : audit [INF] from='client.? 172.21.15.150:0/665966314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7"}]: dispatch 2021-01-28T04:08:40.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[13629]: audit 2021-01-28T04:08:39.847453+0000 mon.a (mon.0) 341 : audit [INF] from='client.? 172.21.15.150:0/665966314' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7"}]': finished 2021-01-28T04:08:40.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[13629]: cluster 2021-01-28T04:08:39.847571+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-28T04:08:40.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:39 smithi150 bash[13629]: audit 2021-01-28T04:08:39.847803+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:08:40.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:39 smithi134 bash[9858]: cluster 2021-01-28T04:08:38.809078+0000 mgr.y (mgr.14138) 144 : cluster [DBG] pgmap v111: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:40.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:39 smithi134 bash[9858]: audit 2021-01-28T04:08:39.837468+0000 mon.a (mon.0) 340 : audit [INF] from='client.? 172.21.15.150:0/665966314' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7"}]: dispatch 2021-01-28T04:08:40.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:39 smithi134 bash[9858]: audit 2021-01-28T04:08:39.847453+0000 mon.a (mon.0) 341 : audit [INF] from='client.? 172.21.15.150:0/665966314' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7"}]': finished 2021-01-28T04:08:40.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:39 smithi134 bash[9858]: cluster 2021-01-28T04:08:39.847571+0000 mon.a (mon.0) 342 : cluster [DBG] osdmap e23: 4 total, 3 up, 3 in 2021-01-28T04:08:40.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:39 smithi134 bash[9858]: audit 2021-01-28T04:08:39.847803+0000 mon.a (mon.0) 343 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:08:41.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:40 smithi150 bash[9867]: audit 2021-01-28T04:08:40.515857+0000 mon.a (mon.0) 344 : audit [DBG] from='client.? 172.21.15.150:0/1963623424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:08:41.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:40 smithi150 bash[13629]: audit 2021-01-28T04:08:40.515857+0000 mon.a (mon.0) 344 : audit [DBG] from='client.? 172.21.15.150:0/1963623424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:08:41.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:40 smithi134 bash[9858]: audit 2021-01-28T04:08:40.515857+0000 mon.a (mon.0) 344 : audit [DBG] from='client.? 172.21.15.150:0/1963623424' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:08:42.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:41 smithi150 bash[9867]: cluster 2021-01-28T04:08:40.809664+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:42.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:41 smithi150 bash[13629]: cluster 2021-01-28T04:08:40.809664+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:42.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:41 smithi134 bash[9858]: cluster 2021-01-28T04:08:40.809664+0000 mgr.y (mgr.14138) 145 : cluster [DBG] pgmap v113: 1 pgs: 1 peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:44.178 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:43 smithi150 bash[13629]: cluster 2021-01-28T04:08:42.810280+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:44.178 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:43 smithi150 bash[13629]: audit 2021-01-28T04:08:43.757242+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:44.179 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:43 smithi150 bash[9867]: cluster 2021-01-28T04:08:42.810280+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:44.179 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:43 smithi150 bash[9867]: audit 2021-01-28T04:08:43.757242+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:44.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:43 smithi134 bash[9858]: cluster 2021-01-28T04:08:42.810280+0000 mgr.y (mgr.14138) 146 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:44.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:43 smithi134 bash[9858]: audit 2021-01-28T04:08:43.757242+0000 mon.a (mon.0) 345 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:46.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:45 smithi150 bash[13629]: cluster 2021-01-28T04:08:44.810895+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:46.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:45 smithi150 bash[9867]: cluster 2021-01-28T04:08:44.810895+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:46.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:45 smithi134 bash[9858]: cluster 2021-01-28T04:08:44.810895+0000 mgr.y (mgr.14138) 147 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:47.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:47 smithi134 bash[9858]: cluster 2021-01-28T04:08:46.811460+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:47.930 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:47 smithi150 bash[9867]: cluster 2021-01-28T04:08:46.811460+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:47.931 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:47 smithi150 bash[13629]: cluster 2021-01-28T04:08:46.811460+0000 mgr.y (mgr.14138) 148 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:48.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:48 smithi134 bash[9858]: audit 2021-01-28T04:08:48.575395+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-28T04:08:48.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:48 smithi134 bash[9858]: audit 2021-01-28T04:08:48.576836+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:48.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:48 smithi134 bash[9858]: audit 2021-01-28T04:08:48.578500+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-28T04:08:48.967 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:48 smithi150 bash[13629]: audit 2021-01-28T04:08:48.575395+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-28T04:08:48.967 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:48 smithi150 bash[13629]: audit 2021-01-28T04:08:48.576836+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:48.968 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:48 smithi150 bash[13629]: audit 2021-01-28T04:08:48.578500+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-28T04:08:48.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:48 smithi150 bash[9867]: audit 2021-01-28T04:08:48.575395+0000 mon.a (mon.0) 346 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2021-01-28T04:08:48.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:48 smithi150 bash[9867]: audit 2021-01-28T04:08:48.576836+0000 mon.a (mon.0) 347 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:08:48.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:48 smithi150 bash[9867]: audit 2021-01-28T04:08:48.578500+0000 mon.a (mon.0) 348 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.3", "key": "container_image"}]: dispatch 2021-01-28T04:08:49.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:49 smithi134 bash[9858]: cephadm 2021-01-28T04:08:48.577927+0000 mgr.y (mgr.14138) 149 : cephadm [INF] Deploying daemon osd.3 on smithi150 2021-01-28T04:08:49.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:49 smithi134 bash[9858]: cluster 2021-01-28T04:08:48.812003+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:49.940 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:49 smithi150 bash[9867]: cephadm 2021-01-28T04:08:48.577927+0000 mgr.y (mgr.14138) 149 : cephadm [INF] Deploying daemon osd.3 on smithi150 2021-01-28T04:08:49.940 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:49 smithi150 bash[9867]: cluster 2021-01-28T04:08:48.812003+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:49.941 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:49 smithi150 bash[13629]: cephadm 2021-01-28T04:08:48.577927+0000 mgr.y (mgr.14138) 149 : cephadm [INF] Deploying daemon osd.3 on smithi150 2021-01-28T04:08:49.941 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:49 smithi150 bash[13629]: cluster 2021-01-28T04:08:48.812003+0000 mgr.y (mgr.14138) 150 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:51.286 INFO:teuthology.orchestra.run.smithi150.stdout:Created osd(s) 3 on host 'smithi150' 2021-01-28T04:08:52.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:51 smithi134 bash[9858]: cluster 2021-01-28T04:08:50.812496+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:52.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:51 smithi134 bash[9858]: audit 2021-01-28T04:08:51.283819+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:52.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:51 smithi134 bash[9858]: audit 2021-01-28T04:08:51.291120+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:52.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:51 smithi150 bash[9867]: cluster 2021-01-28T04:08:50.812496+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:52.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:51 smithi150 bash[9867]: audit 2021-01-28T04:08:51.283819+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:52.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:51 smithi150 bash[9867]: audit 2021-01-28T04:08:51.291120+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:52.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:51 smithi150 bash[13629]: cluster 2021-01-28T04:08:50.812496+0000 mgr.y (mgr.14138) 151 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:52.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:51 smithi150 bash[13629]: audit 2021-01-28T04:08:51.283819+0000 mon.a (mon.0) 349 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:52.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:51 smithi150 bash[13629]: audit 2021-01-28T04:08:51.291120+0000 mon.a (mon.0) 350 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:52.699 DEBUG:teuthology.orchestra.run.smithi150:osd.3> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@osd.3.service 2021-01-28T04:08:52.704 INFO:tasks.cephadm:Deploying osd.4 on smithi134 with /dev/vg_nvme/lv_4... 2021-01-28T04:08:52.705 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2021-01-28T04:08:52.857 INFO:journalctl@ceph.osd.3.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:08:53.615 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:53 smithi150 bash[9867]: audit 2021-01-28T04:08:52.313919+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:53.616 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:53 smithi150 bash[9867]: audit 2021-01-28T04:08:52.315416+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:53.616 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:53 smithi150 bash[9867]: cluster 2021-01-28T04:08:52.813041+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:53.617 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:53 smithi150 bash[13629]: audit 2021-01-28T04:08:52.313919+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:53.617 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:53 smithi150 bash[13629]: audit 2021-01-28T04:08:52.315416+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:53.618 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:53 smithi150 bash[13629]: cluster 2021-01-28T04:08:52.813041+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:53.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:53 smithi134 bash[9858]: audit 2021-01-28T04:08:52.313919+0000 mon.a (mon.0) 351 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:08:53.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:53 smithi134 bash[9858]: audit 2021-01-28T04:08:52.315416+0000 mon.a (mon.0) 352 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:08:53.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:53 smithi134 bash[9858]: cluster 2021-01-28T04:08:52.813041+0000 mgr.y (mgr.14138) 152 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:54.264 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:54 smithi150 bash[23886]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-28T04:08:54.265 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:54 smithi150 bash[23886]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2021-01-28T04:08:54.265 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:54 smithi150 bash[23886]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3/block 2021-01-28T04:08:54.266 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:54 smithi150 bash[23886]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2021-01-28T04:08:54.266 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:54 smithi150 bash[23886]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-28T04:08:54.266 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:54 smithi150 bash[23886]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2021-01-28T04:08:54.267 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:54 smithi150 bash[23886]: --> ceph-volume lvm activate successful for osd ID: 3 2021-01-28T04:08:56.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:55 smithi134 bash[9858]: cluster 2021-01-28T04:08:54.813619+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:56.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:55 smithi150 bash[9867]: cluster 2021-01-28T04:08:54.813619+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:56.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:55 smithi150 bash[13629]: cluster 2021-01-28T04:08:54.813619+0000 mgr.y (mgr.14138) 153 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:56.428 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_4 2021-01-28T04:08:56.428 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2021-01-28T04:08:56.428 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2021-01-28T04:08:56.429 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2021-01-28T04:08:56.429 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0174881 s, 600 MB/s 2021-01-28T04:08:56.429 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2021-01-28T04:08:56.719 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_MESSAGE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).throttle_message 2021-01-28T04:08:56.720 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_BYTES pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).throttle_bytes 2021-01-28T04:08:56.721 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).throttle_dispatch_queue 2021-01-28T04:08:56.721 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).read_frame_segment seg_idx=0 2021-01-28T04:08:56.722 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).read_frame_segment seg_idx=1 2021-01-28T04:08:56.722 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 -- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 msgr2=0x5627c6919e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T04:08:56.723 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).handle_read_frame_segment r=0 2021-01-28T04:08:56.723 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 -- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 msgr2=0x5627c6919e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T04:08:56.724 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).handle_read_frame_epilogue_main r=0 2021-01-28T04:08:56.724 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 10 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).handle_read_frame_dispatch tag=17 2021-01-28T04:08:56.725 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).handle_message 2021-01-28T04:08:56.725 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 5 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=THROTTLE_DONE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.0 off 0 2021-01-28T04:08:56.725 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 5 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=READ_MESSAGE_COMPLETE pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).handle_message received message m=0x5627c692e4e0 seq=4 from=mon.0 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T04:08:56.726 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 -- 172.21.15.150:0/292894528 queue 0x5627c692e4e0 prio 196 2021-01-28T04:08:56.726 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 --2- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 0x5627c6919e00 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x5627c6929e60 tx=0x5627c695e0c0).read_frame 2021-01-28T04:08:56.727 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08d9c3700 1 -- 172.21.15.150:0/292894528 <== mon.0 v2:172.21.15.150:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5627c692e4e0 con 0x5627c69ad000 2021-01-28T04:08:56.727 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08e1c4700 20 -- 172.21.15.150:0/292894528 >> [v2:172.21.15.150:3300/0,v1:172.21.15.150:6789/0] conn(0x5627c69ad000 msgr2=0x5627c6919e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T04:08:56.728 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08d9c3700 10 -- 172.21.15.150:0/292894528 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T04:08:56.728 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:56 smithi150 bash[24235]: debug 2021-01-28T04:08:56.663+0000 7fe08d9c3700 20 -- 172.21.15.150:0/292894528 done calling dispatch on 0x5627c692e4e0 2021-01-28T04:08:57.165 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2021-01-28T04:08:57.468 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:08:57 smithi150 bash[24235]: debug 2021-01-28T04:08:57.215+0000 7fe09544e200 -1 Falling back to public interface 2021-01-28T04:08:57.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:57 smithi134 bash[9858]: cluster 2021-01-28T04:08:56.814008+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:57.881 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:57 smithi150 bash[13629]: cluster 2021-01-28T04:08:56.814008+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:57.881 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:57 smithi150 bash[9867]: cluster 2021-01-28T04:08:56.814008+0000 mgr.y (mgr.14138) 154 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:08:58.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:58 smithi150 bash[9867]: audit 2021-01-28T04:08:58.671822+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:58.969 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:58 smithi150 bash[13629]: audit 2021-01-28T04:08:58.671822+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:08:59.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:58 smithi134 bash[9858]: audit 2021-01-28T04:08:58.671822+0000 mon.a (mon.0) 353 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:00.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:59 smithi134 bash[9858]: cluster 2021-01-28T04:08:58.814395+0000 mgr.y (mgr.14138) 155 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:00.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:59 smithi134 bash[9858]: audit 2021-01-28T04:08:59.037838+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:59 smithi134 bash[9858]: audit 2021-01-28T04:08:59.044536+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:08:59 smithi134 bash[9858]: audit 2021-01-28T04:08:59.052267+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:59 smithi150 bash[13629]: cluster 2021-01-28T04:08:58.814395+0000 mgr.y (mgr.14138) 155 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:00.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:59 smithi150 bash[13629]: audit 2021-01-28T04:08:59.037838+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:59 smithi150 bash[13629]: audit 2021-01-28T04:08:59.044536+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:08:59 smithi150 bash[13629]: audit 2021-01-28T04:08:59.052267+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:59 smithi150 bash[9867]: cluster 2021-01-28T04:08:58.814395+0000 mgr.y (mgr.14138) 155 : cluster [DBG] pgmap v122: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:00.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:59 smithi150 bash[9867]: audit 2021-01-28T04:08:59.037838+0000 mon.a (mon.0) 354 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:59 smithi150 bash[9867]: audit 2021-01-28T04:08:59.044536+0000 mon.a (mon.0) 355 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:08:59 smithi150 bash[9867]: audit 2021-01-28T04:08:59.052267+0000 mon.a (mon.0) 356 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:00.718 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[24235]: debug 2021-01-28T04:09:00.251+0000 7fe09544e200 -1 osd.3 0 log_to_monitors {default=true} 2021-01-28T04:09:01.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:00 smithi134 bash[9858]: cephadm 2021-01-28T04:08:59.045844+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:01.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:00 smithi134 bash[9858]: cephadm 2021-01-28T04:08:59.053179+0000 mgr.y (mgr.14138) 157 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:01.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:00 smithi134 bash[9858]: audit 2021-01-28T04:09:00.260438+0000 mon.b (mon.2) 2 : audit [INF] from='osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T04:09:01.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:00 smithi134 bash[9858]: audit 2021-01-28T04:09:00.264508+0000 mon.a (mon.0) 357 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T04:09:01.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:00 smithi134 bash[9858]: audit 2021-01-28T04:09:00.596289+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:01.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:00 smithi134 bash[9858]: audit 2021-01-28T04:09:00.600275+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:01.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:00 smithi134 bash[9858]: audit 2021-01-28T04:09:00.602246+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:01.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:00 smithi134 bash[9858]: audit 2021-01-28T04:09:00.604634+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:01.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[9867]: cephadm 2021-01-28T04:08:59.045844+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:01.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[9867]: cephadm 2021-01-28T04:08:59.053179+0000 mgr.y (mgr.14138) 157 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:01.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[9867]: audit 2021-01-28T04:09:00.260438+0000 mon.b (mon.2) 2 : audit [INF] from='osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T04:09:01.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[9867]: audit 2021-01-28T04:09:00.264508+0000 mon.a (mon.0) 357 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T04:09:01.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[9867]: audit 2021-01-28T04:09:00.596289+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:01.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[9867]: audit 2021-01-28T04:09:00.600275+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:01.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[9867]: audit 2021-01-28T04:09:00.602246+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:01.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[9867]: audit 2021-01-28T04:09:00.604634+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:01.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[13629]: cephadm 2021-01-28T04:08:59.045844+0000 mgr.y (mgr.14138) 156 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:01.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[13629]: cephadm 2021-01-28T04:08:59.053179+0000 mgr.y (mgr.14138) 157 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:01.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[13629]: audit 2021-01-28T04:09:00.260438+0000 mon.b (mon.2) 2 : audit [INF] from='osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T04:09:01.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[13629]: audit 2021-01-28T04:09:00.264508+0000 mon.a (mon.0) 357 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2021-01-28T04:09:01.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[13629]: audit 2021-01-28T04:09:00.596289+0000 mon.a (mon.0) 358 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:01.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[13629]: audit 2021-01-28T04:09:00.600275+0000 mon.a (mon.0) 359 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:01.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[13629]: audit 2021-01-28T04:09:00.602246+0000 mon.a (mon.0) 360 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:01.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:00 smithi150 bash[13629]: audit 2021-01-28T04:09:00.604634+0000 mon.a (mon.0) 361 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:02.003 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:01 smithi134 bash[9858]: audit 2021-01-28T04:09:00.594100+0000 mgr.y (mgr.14138) 158 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:09:02.003 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:01 smithi134 bash[9858]: cephadm 2021-01-28T04:09:00.599699+0000 mgr.y (mgr.14138) 159 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:09:02.003 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:01 smithi134 bash[9858]: audit 2021-01-28T04:09:00.740848+0000 mon.b (mon.2) 3 : audit [INF] from='osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:09:02.004 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:01 smithi134 bash[9858]: audit 2021-01-28T04:09:00.741795+0000 mon.a (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-28T04:09:02.004 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:01 smithi134 bash[9858]: cluster 2021-01-28T04:09:00.741982+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-28T04:09:02.004 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:01 smithi134 bash[9858]: audit 2021-01-28T04:09:00.742792+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:02.004 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:01 smithi134 bash[9858]: audit 2021-01-28T04:09:00.750939+0000 mon.a (mon.0) 365 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:09:02.004 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:01 smithi134 bash[9858]: cluster 2021-01-28T04:09:00.814916+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:02.218 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[24235]: debug 2021-01-28T04:09:01.759+0000 7fe08d1c2700 -1 osd.3 0 waiting for initial osdmap 2021-01-28T04:09:02.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[9867]: audit 2021-01-28T04:09:00.594100+0000 mgr.y (mgr.14138) 158 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:09:02.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[9867]: cephadm 2021-01-28T04:09:00.599699+0000 mgr.y (mgr.14138) 159 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:09:02.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[9867]: audit 2021-01-28T04:09:00.740848+0000 mon.b (mon.2) 3 : audit [INF] from='osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:09:02.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[9867]: audit 2021-01-28T04:09:00.741795+0000 mon.a (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-28T04:09:02.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[9867]: cluster 2021-01-28T04:09:00.741982+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-28T04:09:02.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[9867]: audit 2021-01-28T04:09:00.742792+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:02.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[9867]: audit 2021-01-28T04:09:00.750939+0000 mon.a (mon.0) 365 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:09:02.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[9867]: cluster 2021-01-28T04:09:00.814916+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:02.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[13629]: audit 2021-01-28T04:09:00.594100+0000 mgr.y (mgr.14138) 158 : audit [DBG] from='client.34205 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:09:02.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[13629]: cephadm 2021-01-28T04:09:00.599699+0000 mgr.y (mgr.14138) 159 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:09:02.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[13629]: audit 2021-01-28T04:09:00.740848+0000 mon.b (mon.2) 3 : audit [INF] from='osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:09:02.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[13629]: audit 2021-01-28T04:09:00.741795+0000 mon.a (mon.0) 362 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2021-01-28T04:09:02.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[13629]: cluster 2021-01-28T04:09:00.741982+0000 mon.a (mon.0) 363 : cluster [DBG] osdmap e24: 4 total, 3 up, 3 in 2021-01-28T04:09:02.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[13629]: audit 2021-01-28T04:09:00.742792+0000 mon.a (mon.0) 364 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:02.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[13629]: audit 2021-01-28T04:09:00.750939+0000 mon.a (mon.0) 365 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]: dispatch 2021-01-28T04:09:02.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:01 smithi150 bash[13629]: cluster 2021-01-28T04:09:00.814916+0000 mgr.y (mgr.14138) 160 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:03.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:02 smithi134 bash[9858]: audit 2021-01-28T04:09:01.752140+0000 mon.a (mon.0) 366 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:09:03.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:02 smithi134 bash[9858]: cluster 2021-01-28T04:09:01.752404+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-28T04:09:03.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:02 smithi134 bash[9858]: audit 2021-01-28T04:09:01.753290+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:03.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:02 smithi134 bash[9858]: audit 2021-01-28T04:09:01.762935+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:03.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:02 smithi150 bash[9867]: audit 2021-01-28T04:09:01.752140+0000 mon.a (mon.0) 366 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:09:03.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:02 smithi150 bash[9867]: cluster 2021-01-28T04:09:01.752404+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-28T04:09:03.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:02 smithi150 bash[9867]: audit 2021-01-28T04:09:01.753290+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:03.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:02 smithi150 bash[9867]: audit 2021-01-28T04:09:01.762935+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:03.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:02 smithi150 bash[13629]: audit 2021-01-28T04:09:01.752140+0000 mon.a (mon.0) 366 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi150", "root=default"]}]': finished 2021-01-28T04:09:03.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:02 smithi150 bash[13629]: cluster 2021-01-28T04:09:01.752404+0000 mon.a (mon.0) 367 : cluster [DBG] osdmap e25: 4 total, 3 up, 3 in 2021-01-28T04:09:03.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:02 smithi150 bash[13629]: audit 2021-01-28T04:09:01.753290+0000 mon.a (mon.0) 368 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:03.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:02 smithi150 bash[13629]: audit 2021-01-28T04:09:01.762935+0000 mon.a (mon.0) 369 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:04.047 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:03 smithi134 bash[9858]: cluster 2021-01-28T04:09:01.255822+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:04.047 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:03 smithi134 bash[9858]: cluster 2021-01-28T04:09:01.256029+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:04.047 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:03 smithi134 bash[9858]: cluster 2021-01-28T04:09:02.763694+0000 mon.a (mon.0) 370 : cluster [INF] osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746] boot 2021-01-28T04:09:04.048 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:03 smithi134 bash[9858]: cluster 2021-01-28T04:09:02.763854+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-28T04:09:04.048 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:03 smithi134 bash[9858]: audit 2021-01-28T04:09:02.765027+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:04.048 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:03 smithi134 bash[9858]: cluster 2021-01-28T04:09:02.815452+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:04.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[9867]: cluster 2021-01-28T04:09:01.255822+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:04.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[9867]: cluster 2021-01-28T04:09:01.256029+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:04.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[9867]: cluster 2021-01-28T04:09:02.763694+0000 mon.a (mon.0) 370 : cluster [INF] osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746] boot 2021-01-28T04:09:04.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[9867]: cluster 2021-01-28T04:09:02.763854+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-28T04:09:04.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[9867]: audit 2021-01-28T04:09:02.765027+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:04.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[9867]: cluster 2021-01-28T04:09:02.815452+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:04.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[13629]: cluster 2021-01-28T04:09:01.255822+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:04.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[13629]: cluster 2021-01-28T04:09:01.256029+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:04.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[13629]: cluster 2021-01-28T04:09:02.763694+0000 mon.a (mon.0) 370 : cluster [INF] osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746] boot 2021-01-28T04:09:04.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[13629]: cluster 2021-01-28T04:09:02.763854+0000 mon.a (mon.0) 371 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2021-01-28T04:09:04.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[13629]: audit 2021-01-28T04:09:02.765027+0000 mon.a (mon.0) 372 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:09:04.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:03 smithi150 bash[13629]: cluster 2021-01-28T04:09:02.815452+0000 mgr.y (mgr.14138) 161 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2021-01-28T04:09:05.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:04 smithi134 bash[9858]: cluster 2021-01-28T04:09:03.781629+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-28T04:09:05.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:04 smithi150 bash[9867]: cluster 2021-01-28T04:09:03.781629+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-28T04:09:05.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:04 smithi150 bash[13629]: cluster 2021-01-28T04:09:03.781629+0000 mon.a (mon.0) 373 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2021-01-28T04:09:06.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:05 smithi134 bash[9858]: cluster 2021-01-28T04:09:04.815988+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:06.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:05 smithi134 bash[9858]: audit 2021-01-28T04:09:04.819183+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.134:0/3954746059' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]: dispatch 2021-01-28T04:09:06.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:05 smithi134 bash[9858]: audit 2021-01-28T04:09:04.823423+0000 mon.a (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]: dispatch 2021-01-28T04:09:06.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:05 smithi134 bash[9858]: audit 2021-01-28T04:09:04.833950+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]': finished 2021-01-28T04:09:06.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:05 smithi134 bash[9858]: cluster 2021-01-28T04:09:04.834145+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-28T04:09:06.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:05 smithi134 bash[9858]: audit 2021-01-28T04:09:04.834372+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:06.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:05 smithi134 bash[9858]: audit 2021-01-28T04:09:05.466371+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.134:0/2408558190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:09:06.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[9867]: cluster 2021-01-28T04:09:04.815988+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:06.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[9867]: audit 2021-01-28T04:09:04.819183+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.134:0/3954746059' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]: dispatch 2021-01-28T04:09:06.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[9867]: audit 2021-01-28T04:09:04.823423+0000 mon.a (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]: dispatch 2021-01-28T04:09:06.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[9867]: audit 2021-01-28T04:09:04.833950+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]': finished 2021-01-28T04:09:06.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[9867]: cluster 2021-01-28T04:09:04.834145+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-28T04:09:06.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[9867]: audit 2021-01-28T04:09:04.834372+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:06.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[9867]: audit 2021-01-28T04:09:05.466371+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.134:0/2408558190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:09:06.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[13629]: cluster 2021-01-28T04:09:04.815988+0000 mgr.y (mgr.14138) 162 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:06.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[13629]: audit 2021-01-28T04:09:04.819183+0000 mon.b (mon.2) 4 : audit [INF] from='client.? 172.21.15.134:0/3954746059' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]: dispatch 2021-01-28T04:09:06.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[13629]: audit 2021-01-28T04:09:04.823423+0000 mon.a (mon.0) 374 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]: dispatch 2021-01-28T04:09:06.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[13629]: audit 2021-01-28T04:09:04.833950+0000 mon.a (mon.0) 375 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6435dc9d-5222-464a-af64-6c0dad1c65ba"}]': finished 2021-01-28T04:09:06.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[13629]: cluster 2021-01-28T04:09:04.834145+0000 mon.a (mon.0) 376 : cluster [DBG] osdmap e28: 5 total, 4 up, 4 in 2021-01-28T04:09:06.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[13629]: audit 2021-01-28T04:09:04.834372+0000 mon.a (mon.0) 377 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:06.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:05 smithi150 bash[13629]: audit 2021-01-28T04:09:05.466371+0000 mon.b (mon.2) 5 : audit [DBG] from='client.? 172.21.15.134:0/2408558190' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:09:07.873 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:07 smithi134 bash[9858]: cluster 2021-01-28T04:09:06.816525+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:07.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:07 smithi150 bash[9867]: cluster 2021-01-28T04:09:06.816525+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:07.969 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:07 smithi150 bash[13629]: cluster 2021-01-28T04:09:06.816525+0000 mgr.y (mgr.14138) 163 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:08.968 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:08 smithi150 bash[13629]: audit 2021-01-28T04:09:08.642515+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:08.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:08 smithi150 bash[9867]: audit 2021-01-28T04:09:08.642515+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:09.021 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:08 smithi134 bash[9858]: audit 2021-01-28T04:09:08.642515+0000 mon.a (mon.0) 378 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:09.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:09 smithi150 bash[9867]: cluster 2021-01-28T04:09:08.817122+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:09.969 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:09 smithi150 bash[13629]: cluster 2021-01-28T04:09:08.817122+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:09.989 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:09 smithi134 bash[9858]: cluster 2021-01-28T04:09:08.817122+0000 mgr.y (mgr.14138) 164 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:12.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:11 smithi134 bash[9858]: cluster 2021-01-28T04:09:10.817703+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:12.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:11 smithi150 bash[9867]: cluster 2021-01-28T04:09:10.817703+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:12.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:11 smithi150 bash[13629]: cluster 2021-01-28T04:09:10.817703+0000 mgr.y (mgr.14138) 165 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:14.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:13 smithi134 bash[9858]: cluster 2021-01-28T04:09:12.818319+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:14.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:13 smithi134 bash[9858]: audit 2021-01-28T04:09:12.934642+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-28T04:09:14.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:13 smithi134 bash[9858]: audit 2021-01-28T04:09:12.936705+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:14.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:13 smithi134 bash[9858]: cephadm 2021-01-28T04:09:12.938235+0000 mgr.y (mgr.14138) 167 : cephadm [INF] Deploying daemon osd.4 on smithi134 2021-01-28T04:09:14.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:13 smithi134 bash[9858]: audit 2021-01-28T04:09:12.939239+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-28T04:09:14.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[9867]: cluster 2021-01-28T04:09:12.818319+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:14.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[9867]: audit 2021-01-28T04:09:12.934642+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-28T04:09:14.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[9867]: audit 2021-01-28T04:09:12.936705+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:14.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[9867]: cephadm 2021-01-28T04:09:12.938235+0000 mgr.y (mgr.14138) 167 : cephadm [INF] Deploying daemon osd.4 on smithi134 2021-01-28T04:09:14.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[9867]: audit 2021-01-28T04:09:12.939239+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-28T04:09:14.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[13629]: cluster 2021-01-28T04:09:12.818319+0000 mgr.y (mgr.14138) 166 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:14.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[13629]: audit 2021-01-28T04:09:12.934642+0000 mon.a (mon.0) 379 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2021-01-28T04:09:14.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[13629]: audit 2021-01-28T04:09:12.936705+0000 mon.a (mon.0) 380 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:14.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[13629]: cephadm 2021-01-28T04:09:12.938235+0000 mgr.y (mgr.14138) 167 : cephadm [INF] Deploying daemon osd.4 on smithi134 2021-01-28T04:09:14.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:13 smithi150 bash[13629]: audit 2021-01-28T04:09:12.939239+0000 mon.a (mon.0) 381 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.4", "key": "container_image"}]: dispatch 2021-01-28T04:09:15.565 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 4 on host 'smithi134' 2021-01-28T04:09:15.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:15 smithi134 bash[9858]: cluster 2021-01-28T04:09:14.818879+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:15.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:15 smithi134 bash[9858]: audit 2021-01-28T04:09:15.562283+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:15.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:15 smithi134 bash[9858]: audit 2021-01-28T04:09:15.567443+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:16.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:15 smithi150 bash[9867]: cluster 2021-01-28T04:09:14.818879+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:16.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:15 smithi150 bash[9867]: audit 2021-01-28T04:09:15.562283+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:16.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:15 smithi150 bash[9867]: audit 2021-01-28T04:09:15.567443+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:16.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:15 smithi150 bash[13629]: cluster 2021-01-28T04:09:14.818879+0000 mgr.y (mgr.14138) 168 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:16.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:15 smithi150 bash[13629]: audit 2021-01-28T04:09:15.562283+0000 mon.a (mon.0) 382 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:16.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:15 smithi150 bash[13629]: audit 2021-01-28T04:09:15.567443+0000 mon.a (mon.0) 383 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:17.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:16 smithi134 bash[9858]: cephadm 2021-01-28T04:09:15.561140+0000 mgr.y (mgr.14138) 169 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:09:17.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:16 smithi134 bash[9858]: audit 2021-01-28T04:09:16.492709+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:17.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:16 smithi134 bash[9858]: audit 2021-01-28T04:09:16.494520+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:17.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:16 smithi150 bash[9867]: cephadm 2021-01-28T04:09:15.561140+0000 mgr.y (mgr.14138) 169 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:09:17.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:16 smithi150 bash[9867]: audit 2021-01-28T04:09:16.492709+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:17.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:16 smithi150 bash[9867]: audit 2021-01-28T04:09:16.494520+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:17.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:16 smithi150 bash[13629]: cephadm 2021-01-28T04:09:15.561140+0000 mgr.y (mgr.14138) 169 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:09:17.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:16 smithi150 bash[13629]: audit 2021-01-28T04:09:16.492709+0000 mon.a (mon.0) 384 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:17.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:16 smithi150 bash[13629]: audit 2021-01-28T04:09:16.494520+0000 mon.a (mon.0) 385 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:17.334 DEBUG:teuthology.orchestra.run.smithi134:osd.4> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@osd.4.service 2021-01-28T04:09:17.336 INFO:tasks.cephadm:Deploying osd.5 on smithi134 with /dev/vg_nvme/lv_3... 2021-01-28T04:09:17.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2021-01-28T04:09:17.396 INFO:journalctl@ceph.osd.4.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:09:18.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:17 smithi134 bash[9858]: cluster 2021-01-28T04:09:16.819503+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:18.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:17 smithi150 bash[9867]: cluster 2021-01-28T04:09:16.819503+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:18.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:17 smithi150 bash[13629]: cluster 2021-01-28T04:09:16.819503+0000 mgr.y (mgr.14138) 170 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:19.135 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:18 smithi134 bash[12374]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-28T04:09:19.135 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:18 smithi134 bash[12374]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2021-01-28T04:09:19.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:18 smithi134 bash[12374]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4/block 2021-01-28T04:09:19.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:18 smithi134 bash[12374]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2021-01-28T04:09:19.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:18 smithi134 bash[12374]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2021-01-28T04:09:19.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:18 smithi134 bash[12374]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2021-01-28T04:09:19.137 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:18 smithi134 bash[12374]: --> ceph-volume lvm activate successful for osd ID: 4 2021-01-28T04:09:20.040 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:19 smithi134 bash[9858]: cluster 2021-01-28T04:09:18.820138+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:20.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:19 smithi150 bash[9867]: cluster 2021-01-28T04:09:18.820138+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:20.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:19 smithi150 bash[13629]: cluster 2021-01-28T04:09:18.820138+0000 mgr.y (mgr.14138) 171 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:22.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:21 smithi150 bash[9867]: cluster 2021-01-28T04:09:20.820665+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:22.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:21 smithi150 bash[9867]: audit 2021-01-28T04:09:20.942696+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:09:22.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:21 smithi150 bash[9867]: audit 2021-01-28T04:09:20.949719+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:09:22.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:21 smithi150 bash[13629]: cluster 2021-01-28T04:09:20.820665+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:22.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:21 smithi150 bash[13629]: audit 2021-01-28T04:09:20.942696+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:09:22.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:21 smithi150 bash[13629]: audit 2021-01-28T04:09:20.949719+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:09:22.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:21 smithi134 bash[9858]: cluster 2021-01-28T04:09:20.820665+0000 mgr.y (mgr.14138) 172 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:22.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:21 smithi134 bash[9858]: audit 2021-01-28T04:09:20.942696+0000 mon.a (mon.0) 386 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:09:22.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:21 smithi134 bash[9858]: audit 2021-01-28T04:09:20.949719+0000 mon.a (mon.0) 387 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:09:23.135 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:22 smithi134 bash[12665]: debug 2021-01-28T04:09:22.976+0000 7f7ccd3c5700 10 -- 172.21.15.134:0/2090760609 dispatch_throttle_release 413 to dispatch throttler 413/104857600 2021-01-28T04:09:23.135 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:22 smithi134 bash[12665]: debug 2021-01-28T04:09:22.976+0000 7f7ccd3c5700 20 -- 172.21.15.134:0/2090760609 done calling dispatch on 0x56251ddecc60 2021-01-28T04:09:23.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:22 smithi134 bash[12665]: debug 2021-01-28T04:09:22.976+0000 7f7ccdbc6700 10 -- 172.21.15.134:0/2090760609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56251de75000 msgr2=0x56251dde1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send sent bytes 160 remaining bytes 0 2021-01-28T04:09:23.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:22 smithi134 bash[12665]: debug 2021-01-28T04:09:22.976+0000 7f7ccdbc6700 10 --2- 172.21.15.134:0/2090760609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56251de75000 0x56251dde1e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x56251ddf1e60 tx=0x56251de26d80).write_message sending 0x56251de17b00 done. 2021-01-28T04:09:23.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:22 smithi134 bash[12665]: debug 2021-01-28T04:09:22.976+0000 7f7ccdbc6700 20 -- 172.21.15.134:0/2090760609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56251de75000 msgr2=0x56251dde1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T04:09:23.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:22 smithi134 bash[12665]: debug 2021-01-28T04:09:22.976+0000 7f7ccdbc6700 20 -- 172.21.15.134:0/2090760609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56251de75000 msgr2=0x56251dde1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T04:09:23.136 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:22 smithi134 bash[12665]: debug 2021-01-28T04:09:22.976+0000 7f7ccdbc6700 20 --2- 172.21.15.134:0/2090760609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56251de75000 0x56251dde1e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x56251ddf1e60 tx=0x56251de26d80).handle_read_frame_preamble_main r=0 2021-01-28T04:09:23.885 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:23 smithi134 bash[12665]: debug 2021-01-28T04:09:23.508+0000 7f7cd4e50200 -1 Falling back to public interface 2021-01-28T04:09:24.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:23 smithi150 bash[9867]: cluster 2021-01-28T04:09:22.821196+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:24.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:23 smithi150 bash[13629]: cluster 2021-01-28T04:09:22.821196+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:24.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:23 smithi134 bash[9858]: cluster 2021-01-28T04:09:22.821196+0000 mgr.y (mgr.14138) 173 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:24.619 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_3 2021-01-28T04:09:24.620 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2021-01-28T04:09:24.620 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2021-01-28T04:09:24.620 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2021-01-28T04:09:24.621 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0176036 s, 596 MB/s 2021-01-28T04:09:24.621 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2021-01-28T04:09:25.674 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2021-01-28T04:09:26.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:25 smithi134 bash[9858]: cluster 2021-01-28T04:09:24.821761+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:26.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:25 smithi150 bash[9867]: cluster 2021-01-28T04:09:24.821761+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:26.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:25 smithi150 bash[13629]: cluster 2021-01-28T04:09:24.821761+0000 mgr.y (mgr.14138) 174 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:26.885 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:26 smithi134 bash[12665]: debug 2021-01-28T04:09:26.596+0000 7f7cd4e50200 -1 osd.4 0 log_to_monitors {default=true} 2021-01-28T04:09:27.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[9867]: audit 2021-01-28T04:09:26.224320+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:27.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[9867]: audit 2021-01-28T04:09:26.605729+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T04:09:27.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[9867]: audit 2021-01-28T04:09:26.607576+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:27.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[9867]: audit 2021-01-28T04:09:26.609871+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T04:09:27.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[9867]: audit 2021-01-28T04:09:26.617391+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:27.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[9867]: audit 2021-01-28T04:09:26.624686+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:27.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[13629]: audit 2021-01-28T04:09:26.224320+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:27.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[13629]: audit 2021-01-28T04:09:26.605729+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T04:09:27.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[13629]: audit 2021-01-28T04:09:26.607576+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:27.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[13629]: audit 2021-01-28T04:09:26.609871+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T04:09:27.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[13629]: audit 2021-01-28T04:09:26.617391+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:27.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:26 smithi150 bash[13629]: audit 2021-01-28T04:09:26.624686+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:27.239 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:26 smithi134 bash[9858]: audit 2021-01-28T04:09:26.224320+0000 mon.a (mon.0) 388 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:27.240 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:26 smithi134 bash[9858]: audit 2021-01-28T04:09:26.605729+0000 mon.b (mon.2) 6 : audit [INF] from='osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T04:09:27.240 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:26 smithi134 bash[9858]: audit 2021-01-28T04:09:26.607576+0000 mon.a (mon.0) 389 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:27.240 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:26 smithi134 bash[9858]: audit 2021-01-28T04:09:26.609871+0000 mon.a (mon.0) 390 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2021-01-28T04:09:27.240 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:26 smithi134 bash[9858]: audit 2021-01-28T04:09:26.617391+0000 mon.a (mon.0) 391 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:27.240 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:26 smithi134 bash[9858]: audit 2021-01-28T04:09:26.624686+0000 mon.a (mon.0) 392 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:28.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:27 smithi134 bash[9858]: cephadm 2021-01-28T04:09:26.618754+0000 mgr.y (mgr.14138) 175 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:28.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:27 smithi134 bash[9858]: cephadm 2021-01-28T04:09:26.626178+0000 mgr.y (mgr.14138) 176 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:28.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:27 smithi134 bash[9858]: cluster 2021-01-28T04:09:26.822335+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:28.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:27 smithi134 bash[9858]: audit 2021-01-28T04:09:27.610994+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:28.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:27 smithi134 bash[9858]: audit 2021-01-28T04:09:27.611703+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-28T04:09:28.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:27 smithi134 bash[9858]: cluster 2021-01-28T04:09:27.611864+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-28T04:09:28.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:27 smithi134 bash[9858]: audit 2021-01-28T04:09:27.612136+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:28.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:27 smithi134 bash[9858]: audit 2021-01-28T04:09:27.615000+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:28.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[13629]: cephadm 2021-01-28T04:09:26.618754+0000 mgr.y (mgr.14138) 175 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:28.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[13629]: cephadm 2021-01-28T04:09:26.626178+0000 mgr.y (mgr.14138) 176 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:28.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[13629]: cluster 2021-01-28T04:09:26.822335+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:28.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[13629]: audit 2021-01-28T04:09:27.610994+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:28.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[13629]: audit 2021-01-28T04:09:27.611703+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-28T04:09:28.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[13629]: cluster 2021-01-28T04:09:27.611864+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-28T04:09:28.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[13629]: audit 2021-01-28T04:09:27.612136+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:28.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[13629]: audit 2021-01-28T04:09:27.615000+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:28.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[9867]: cephadm 2021-01-28T04:09:26.618754+0000 mgr.y (mgr.14138) 175 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:28.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[9867]: cephadm 2021-01-28T04:09:26.626178+0000 mgr.y (mgr.14138) 176 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:28.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[9867]: cluster 2021-01-28T04:09:26.822335+0000 mgr.y (mgr.14138) 177 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:28.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[9867]: audit 2021-01-28T04:09:27.610994+0000 mon.b (mon.2) 7 : audit [INF] from='osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:28.223 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[9867]: audit 2021-01-28T04:09:27.611703+0000 mon.a (mon.0) 393 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2021-01-28T04:09:28.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[9867]: cluster 2021-01-28T04:09:27.611864+0000 mon.a (mon.0) 394 : cluster [DBG] osdmap e29: 5 total, 4 up, 4 in 2021-01-28T04:09:28.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[9867]: audit 2021-01-28T04:09:27.612136+0000 mon.a (mon.0) 395 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:28.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:27 smithi150 bash[9867]: audit 2021-01-28T04:09:27.615000+0000 mon.a (mon.0) 396 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:28.884 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:09:28 smithi134 bash[12665]: debug 2021-01-28T04:09:28.616+0000 7f7ccb3c1700 -1 osd.4 0 waiting for initial osdmap 2021-01-28T04:09:29.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: cluster 2021-01-28T04:09:27.575805+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:29.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: cluster 2021-01-28T04:09:27.576014+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:29.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: audit 2021-01-28T04:09:28.615361+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:09:29.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: cluster 2021-01-28T04:09:28.616019+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-28T04:09:29.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: audit 2021-01-28T04:09:28.616561+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:29.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: audit 2021-01-28T04:09:28.624127+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:29.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: cluster 2021-01-28T04:09:28.822905+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:29.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: audit 2021-01-28T04:09:29.213668+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:29.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: audit 2021-01-28T04:09:29.217139+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:29.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: audit 2021-01-28T04:09:29.218872+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:29.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:29 smithi134 bash[9858]: audit 2021-01-28T04:09:29.220888+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:29.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: cluster 2021-01-28T04:09:27.575805+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:29.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: cluster 2021-01-28T04:09:27.576014+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:29.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: audit 2021-01-28T04:09:28.615361+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:09:29.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: cluster 2021-01-28T04:09:28.616019+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-28T04:09:29.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: audit 2021-01-28T04:09:28.616561+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:29.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: audit 2021-01-28T04:09:28.624127+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:29.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: cluster 2021-01-28T04:09:28.822905+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:29.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: audit 2021-01-28T04:09:29.213668+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:29.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: audit 2021-01-28T04:09:29.217139+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:29.970 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: audit 2021-01-28T04:09:29.218872+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:29.971 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[9867]: audit 2021-01-28T04:09:29.220888+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:29.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: cluster 2021-01-28T04:09:27.575805+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:29.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: cluster 2021-01-28T04:09:27.576014+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:29.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: audit 2021-01-28T04:09:28.615361+0000 mon.a (mon.0) 397 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:09:29.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: cluster 2021-01-28T04:09:28.616019+0000 mon.a (mon.0) 398 : cluster [DBG] osdmap e30: 5 total, 4 up, 4 in 2021-01-28T04:09:29.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: audit 2021-01-28T04:09:28.616561+0000 mon.a (mon.0) 399 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:29.972 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: audit 2021-01-28T04:09:28.624127+0000 mon.a (mon.0) 400 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:29.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: cluster 2021-01-28T04:09:28.822905+0000 mgr.y (mgr.14138) 178 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 20 MiB used, 358 GiB / 358 GiB avail 2021-01-28T04:09:29.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: audit 2021-01-28T04:09:29.213668+0000 mon.a (mon.0) 401 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:29.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: audit 2021-01-28T04:09:29.217139+0000 mon.a (mon.0) 402 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:29.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: audit 2021-01-28T04:09:29.218872+0000 mon.a (mon.0) 403 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:29.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:29 smithi150 bash[13629]: audit 2021-01-28T04:09:29.220888+0000 mon.a (mon.0) 404 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:30.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:30 smithi134 bash[9858]: audit 2021-01-28T04:09:29.211570+0000 mgr.y (mgr.14138) 179 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:09:30.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:30 smithi134 bash[9858]: cephadm 2021-01-28T04:09:29.216585+0000 mgr.y (mgr.14138) 180 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:09:30.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:30 smithi134 bash[9858]: cluster 2021-01-28T04:09:29.625649+0000 mon.a (mon.0) 405 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:09:30.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:30 smithi134 bash[9858]: cluster 2021-01-28T04:09:29.625722+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-28T04:09:30.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:30 smithi134 bash[9858]: audit 2021-01-28T04:09:29.626345+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:30.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[9867]: audit 2021-01-28T04:09:29.211570+0000 mgr.y (mgr.14138) 179 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:09:30.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[9867]: cephadm 2021-01-28T04:09:29.216585+0000 mgr.y (mgr.14138) 180 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:09:30.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[9867]: cluster 2021-01-28T04:09:29.625649+0000 mon.a (mon.0) 405 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:09:30.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[9867]: cluster 2021-01-28T04:09:29.625722+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-28T04:09:30.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[9867]: audit 2021-01-28T04:09:29.626345+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:30.970 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[13629]: audit 2021-01-28T04:09:29.211570+0000 mgr.y (mgr.14138) 179 : audit [DBG] from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:09:30.970 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[13629]: cephadm 2021-01-28T04:09:29.216585+0000 mgr.y (mgr.14138) 180 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:09:30.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[13629]: cluster 2021-01-28T04:09:29.625649+0000 mon.a (mon.0) 405 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:09:30.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[13629]: cluster 2021-01-28T04:09:29.625722+0000 mon.a (mon.0) 406 : cluster [DBG] osdmap e31: 5 total, 5 up, 5 in 2021-01-28T04:09:30.971 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:30 smithi150 bash[13629]: audit 2021-01-28T04:09:29.626345+0000 mon.a (mon.0) 407 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:09:31.884 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:31 smithi134 bash[9858]: cluster 2021-01-28T04:09:30.625363+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-28T04:09:31.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:31 smithi134 bash[9858]: cluster 2021-01-28T04:09:30.823492+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:31.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:31 smithi150 bash[9867]: cluster 2021-01-28T04:09:30.625363+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-28T04:09:31.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:31 smithi150 bash[9867]: cluster 2021-01-28T04:09:30.823492+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:31.968 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:31 smithi150 bash[13629]: cluster 2021-01-28T04:09:30.625363+0000 mon.a (mon.0) 408 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2021-01-28T04:09:31.969 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:31 smithi150 bash[13629]: cluster 2021-01-28T04:09:30.823492+0000 mgr.y (mgr.14138) 181 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:34.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:33 smithi134 bash[9858]: cluster 2021-01-28T04:09:32.824072+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:35.007 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:33 smithi134 bash[9858]: audit 2021-01-28T04:09:33.379278+0000 mon.a (mon.0) 409 : audit [INF] from='client.? 172.21.15.134:0/1953844112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d31b1648-1ba1-4895-b27f-9182737d7b30"}]: dispatch 2021-01-28T04:09:35.007 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:33 smithi134 bash[9858]: audit 2021-01-28T04:09:33.388277+0000 mon.a (mon.0) 410 : audit [INF] from='client.? 172.21.15.134:0/1953844112' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d31b1648-1ba1-4895-b27f-9182737d7b30"}]': finished 2021-01-28T04:09:35.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:33 smithi134 bash[9858]: cluster 2021-01-28T04:09:33.388427+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-28T04:09:35.008 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:33 smithi134 bash[9858]: audit 2021-01-28T04:09:33.389201+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:35.010 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[9867]: cluster 2021-01-28T04:09:32.824072+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:35.010 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[9867]: audit 2021-01-28T04:09:33.379278+0000 mon.a (mon.0) 409 : audit [INF] from='client.? 172.21.15.134:0/1953844112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d31b1648-1ba1-4895-b27f-9182737d7b30"}]: dispatch 2021-01-28T04:09:35.011 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[9867]: audit 2021-01-28T04:09:33.388277+0000 mon.a (mon.0) 410 : audit [INF] from='client.? 172.21.15.134:0/1953844112' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d31b1648-1ba1-4895-b27f-9182737d7b30"}]': finished 2021-01-28T04:09:35.011 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[9867]: cluster 2021-01-28T04:09:33.388427+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-28T04:09:35.011 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[9867]: audit 2021-01-28T04:09:33.389201+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:35.012 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[13629]: cluster 2021-01-28T04:09:32.824072+0000 mgr.y (mgr.14138) 182 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:35.012 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[13629]: audit 2021-01-28T04:09:33.379278+0000 mon.a (mon.0) 409 : audit [INF] from='client.? 172.21.15.134:0/1953844112' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d31b1648-1ba1-4895-b27f-9182737d7b30"}]: dispatch 2021-01-28T04:09:35.013 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[13629]: audit 2021-01-28T04:09:33.388277+0000 mon.a (mon.0) 410 : audit [INF] from='client.? 172.21.15.134:0/1953844112' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d31b1648-1ba1-4895-b27f-9182737d7b30"}]': finished 2021-01-28T04:09:35.014 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[13629]: cluster 2021-01-28T04:09:33.388427+0000 mon.a (mon.0) 411 : cluster [DBG] osdmap e33: 6 total, 5 up, 5 in 2021-01-28T04:09:35.014 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:33 smithi150 bash[13629]: audit 2021-01-28T04:09:33.389201+0000 mon.a (mon.0) 412 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:35.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:34 smithi134 bash[9858]: audit 2021-01-28T04:09:34.046464+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.134:0/2286251850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:09:35.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:34 smithi150 bash[9867]: audit 2021-01-28T04:09:34.046464+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.134:0/2286251850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:09:35.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:34 smithi150 bash[13629]: audit 2021-01-28T04:09:34.046464+0000 mon.b (mon.2) 8 : audit [DBG] from='client.? 172.21.15.134:0/2286251850' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:09:36.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:35 smithi150 bash[9867]: cluster 2021-01-28T04:09:34.824669+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:36.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:35 smithi150 bash[13629]: cluster 2021-01-28T04:09:34.824669+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:36.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:35 smithi134 bash[9858]: cluster 2021-01-28T04:09:34.824669+0000 mgr.y (mgr.14138) 183 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:37.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:37 smithi134 bash[9858]: cluster 2021-01-28T04:09:36.825353+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:37.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:37 smithi134 bash[9858]: audit 2021-01-28T04:09:37.245942+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:37.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:37 smithi150 bash[9867]: cluster 2021-01-28T04:09:36.825353+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:37.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:37 smithi150 bash[9867]: audit 2021-01-28T04:09:37.245942+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:37.968 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:37 smithi150 bash[13629]: cluster 2021-01-28T04:09:36.825353+0000 mgr.y (mgr.14138) 184 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:37.969 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:37 smithi150 bash[13629]: audit 2021-01-28T04:09:37.245942+0000 mon.a (mon.0) 413 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:40.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:39 smithi134 bash[9858]: cluster 2021-01-28T04:09:38.826079+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:40.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:39 smithi150 bash[9867]: cluster 2021-01-28T04:09:38.826079+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:40.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:39 smithi150 bash[13629]: cluster 2021-01-28T04:09:38.826079+0000 mgr.y (mgr.14138) 185 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:42.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:41 smithi134 bash[9858]: cluster 2021-01-28T04:09:40.826702+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:42.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:41 smithi134 bash[9858]: audit 2021-01-28T04:09:41.848769+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-28T04:09:42.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:41 smithi134 bash[9858]: audit 2021-01-28T04:09:41.850542+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:42.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:41 smithi134 bash[9858]: audit 2021-01-28T04:09:41.852894+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-28T04:09:42.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:41 smithi150 bash[9867]: cluster 2021-01-28T04:09:40.826702+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:42.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:41 smithi150 bash[9867]: audit 2021-01-28T04:09:41.848769+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-28T04:09:42.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:41 smithi150 bash[9867]: audit 2021-01-28T04:09:41.850542+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:42.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:41 smithi150 bash[9867]: audit 2021-01-28T04:09:41.852894+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-28T04:09:42.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:41 smithi150 bash[13629]: cluster 2021-01-28T04:09:40.826702+0000 mgr.y (mgr.14138) 186 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:42.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:41 smithi150 bash[13629]: audit 2021-01-28T04:09:41.848769+0000 mon.a (mon.0) 414 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2021-01-28T04:09:42.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:41 smithi150 bash[13629]: audit 2021-01-28T04:09:41.850542+0000 mon.a (mon.0) 415 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:42.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:41 smithi150 bash[13629]: audit 2021-01-28T04:09:41.852894+0000 mon.a (mon.0) 416 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.5", "key": "container_image"}]: dispatch 2021-01-28T04:09:43.179 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:42 smithi134 bash[9858]: cephadm 2021-01-28T04:09:41.851964+0000 mgr.y (mgr.14138) 187 : cephadm [INF] Deploying daemon osd.5 on smithi134 2021-01-28T04:09:43.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:42 smithi150 bash[9867]: cephadm 2021-01-28T04:09:41.851964+0000 mgr.y (mgr.14138) 187 : cephadm [INF] Deploying daemon osd.5 on smithi134 2021-01-28T04:09:43.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:42 smithi150 bash[13629]: cephadm 2021-01-28T04:09:41.851964+0000 mgr.y (mgr.14138) 187 : cephadm [INF] Deploying daemon osd.5 on smithi134 2021-01-28T04:09:44.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:43 smithi134 bash[9858]: cluster 2021-01-28T04:09:42.827283+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:44.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:43 smithi150 bash[9867]: cluster 2021-01-28T04:09:42.827283+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:44.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:43 smithi150 bash[13629]: cluster 2021-01-28T04:09:42.827283+0000 mgr.y (mgr.14138) 188 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:44.560 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 5 on host 'smithi134' 2021-01-28T04:09:45.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:44 smithi150 bash[9867]: audit 2021-01-28T04:09:44.557847+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:45.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:44 smithi150 bash[9867]: audit 2021-01-28T04:09:44.563226+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:45.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:44 smithi150 bash[13629]: audit 2021-01-28T04:09:44.557847+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:45.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:44 smithi150 bash[13629]: audit 2021-01-28T04:09:44.563226+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:45.304 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:44 smithi134 bash[9858]: audit 2021-01-28T04:09:44.557847+0000 mon.a (mon.0) 417 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:45.304 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:44 smithi134 bash[9858]: audit 2021-01-28T04:09:44.563226+0000 mon.a (mon.0) 418 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:46.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:45 smithi150 bash[9867]: cluster 2021-01-28T04:09:44.827886+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:46.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:45 smithi150 bash[9867]: audit 2021-01-28T04:09:45.528643+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:46.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:45 smithi150 bash[9867]: audit 2021-01-28T04:09:45.530617+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:46.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:45 smithi150 bash[13629]: cluster 2021-01-28T04:09:44.827886+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:46.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:45 smithi150 bash[13629]: audit 2021-01-28T04:09:45.528643+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:46.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:45 smithi150 bash[13629]: audit 2021-01-28T04:09:45.530617+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:46.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:45 smithi134 bash[9858]: cluster 2021-01-28T04:09:44.827886+0000 mgr.y (mgr.14138) 189 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:46.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:45 smithi134 bash[9858]: audit 2021-01-28T04:09:45.528643+0000 mon.a (mon.0) 419 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:46.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:45 smithi134 bash[9858]: audit 2021-01-28T04:09:45.530617+0000 mon.a (mon.0) 420 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:46.549 DEBUG:teuthology.orchestra.run.smithi134:osd.5> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@osd.5.service 2021-01-28T04:09:46.552 INFO:tasks.cephadm:Deploying osd.6 on smithi134 with /dev/vg_nvme/lv_2... 2021-01-28T04:09:46.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2021-01-28T04:09:46.648 INFO:journalctl@ceph.osd.5.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:09:47.884 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:47 smithi134 bash[9858]: cluster 2021-01-28T04:09:46.828425+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:47.885 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:47 smithi134 bash[14826]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-28T04:09:47.885 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:47 smithi134 bash[14826]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2021-01-28T04:09:47.885 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:47 smithi134 bash[14826]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5/block 2021-01-28T04:09:47.885 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:47 smithi134 bash[14826]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2021-01-28T04:09:47.886 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:47 smithi134 bash[14826]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2021-01-28T04:09:47.886 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:47 smithi134 bash[14826]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2021-01-28T04:09:47.886 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:47 smithi134 bash[14826]: --> ceph-volume lvm activate successful for osd ID: 5 2021-01-28T04:09:47.967 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:47 smithi150 bash[9867]: cluster 2021-01-28T04:09:46.828425+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:47.968 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:47 smithi150 bash[13629]: cluster 2021-01-28T04:09:46.828425+0000 mgr.y (mgr.14138) 190 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:50.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:49 smithi134 bash[9858]: cluster 2021-01-28T04:09:48.829005+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:50.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:49 smithi150 bash[9867]: cluster 2021-01-28T04:09:48.829005+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:50.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:49 smithi150 bash[13629]: cluster 2021-01-28T04:09:48.829005+0000 mgr.y (mgr.14138) 191 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:51.884 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 -- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 msgr2=0x55f0f0c78300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T04:09:51.884 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 -- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 msgr2=0x55f0f0c78300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T04:09:51.885 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).handle_read_frame_preamble_main r=0 2021-01-28T04:09:51.885 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_MESSAGE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).throttle_message 2021-01-28T04:09:51.885 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_BYTES pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).throttle_bytes 2021-01-28T04:09:51.885 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).throttle_dispatch_queue 2021-01-28T04:09:51.886 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).read_frame_segment seg_idx=0 2021-01-28T04:09:51.886 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).read_frame_segment seg_idx=1 2021-01-28T04:09:51.886 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 -- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 msgr2=0x55f0f0c78300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T04:09:51.887 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).handle_read_frame_segment r=0 2021-01-28T04:09:51.887 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 -- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 msgr2=0x55f0f0c78300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T04:09:51.887 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).handle_read_frame_epilogue_main r=0 2021-01-28T04:09:51.888 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 10 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).handle_read_frame_dispatch tag=17 2021-01-28T04:09:51.888 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).handle_message 2021-01-28T04:09:51.889 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 5 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=THROTTLE_DONE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-28T04:09:51.889 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 5 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=READ_MESSAGE_COMPLETE pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).handle_message received message m=0x55f0f0c8c4e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T04:09:51.889 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 -- 172.21.15.134:0/1286827980 queue 0x55f0f0c8c4e0 prio 196 2021-01-28T04:09:51.890 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 --2- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 0x55f0f0c78300 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x55f0f0c87e60 tx=0x55f0f0cbcd80).read_frame 2021-01-28T04:09:51.890 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdca144700 20 -- 172.21.15.134:0/1286827980 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0f0d0b400 msgr2=0x55f0f0c78300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T04:09:51.890 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdc8941700 1 -- 172.21.15.134:0/1286827980 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55f0f0c8c4e0 con 0x55f0f0d0b400 2021-01-28T04:09:51.891 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdc8941700 10 -- 172.21.15.134:0/1286827980 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T04:09:51.891 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[15130]: debug 2021-01-28T04:09:51.792+0000 7fcdc8941700 20 -- 172.21.15.134:0/1286827980 done calling dispatch on 0x55f0f0c8c4e0 2021-01-28T04:09:52.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:51 smithi134 bash[9858]: cluster 2021-01-28T04:09:50.829581+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:52.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:51 smithi150 bash[9867]: cluster 2021-01-28T04:09:50.829581+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:52.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:51 smithi150 bash[13629]: cluster 2021-01-28T04:09:50.829581+0000 mgr.y (mgr.14138) 192 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:52.634 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:52 smithi134 bash[15130]: debug 2021-01-28T04:09:52.336+0000 7fcdd03cc200 -1 Falling back to public interface 2021-01-28T04:09:53.707 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_2 2021-01-28T04:09:53.707 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2021-01-28T04:09:53.708 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2021-01-28T04:09:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2021-01-28T04:09:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0154248 s, 680 MB/s 2021-01-28T04:09:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2021-01-28T04:09:54.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:53 smithi134 bash[9858]: cluster 2021-01-28T04:09:52.830124+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:54.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:53 smithi150 bash[13629]: cluster 2021-01-28T04:09:52.830124+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:54.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:53 smithi150 bash[9867]: cluster 2021-01-28T04:09:52.830124+0000 mgr.y (mgr.14138) 193 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:54.564 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2021-01-28T04:09:55.634 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:55 smithi134 bash[15130]: debug 2021-01-28T04:09:55.384+0000 7fcdd03cc200 -1 osd.5 0 log_to_monitors {default=true} 2021-01-28T04:09:56.994 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:55 smithi150 bash[9867]: cluster 2021-01-28T04:09:54.830745+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:56.995 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:55 smithi150 bash[9867]: audit 2021-01-28T04:09:55.394096+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T04:09:56.995 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:55 smithi150 bash[9867]: audit 2021-01-28T04:09:55.398197+0000 mon.a (mon.0) 421 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T04:09:56.995 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:55 smithi150 bash[9867]: audit 2021-01-28T04:09:55.585219+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:56.995 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:55 smithi150 bash[13629]: cluster 2021-01-28T04:09:54.830745+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:56.996 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:55 smithi150 bash[13629]: audit 2021-01-28T04:09:55.394096+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T04:09:56.996 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:55 smithi150 bash[13629]: audit 2021-01-28T04:09:55.398197+0000 mon.a (mon.0) 421 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T04:09:56.996 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:55 smithi150 bash[13629]: audit 2021-01-28T04:09:55.585219+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:56.996 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:55 smithi134 bash[9858]: cluster 2021-01-28T04:09:54.830745+0000 mgr.y (mgr.14138) 194 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:56.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:55 smithi134 bash[9858]: audit 2021-01-28T04:09:55.394096+0000 mon.b (mon.2) 9 : audit [INF] from='osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T04:09:56.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:55 smithi134 bash[9858]: audit 2021-01-28T04:09:55.398197+0000 mon.a (mon.0) 421 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2021-01-28T04:09:56.997 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:55 smithi134 bash[9858]: audit 2021-01-28T04:09:55.585219+0000 mon.a (mon.0) 422 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:09:57.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[9867]: audit 2021-01-28T04:09:55.905426+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:57.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[9867]: audit 2021-01-28T04:09:55.906927+0000 mon.a (mon.0) 423 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-28T04:09:57.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[9867]: cluster 2021-01-28T04:09:55.907026+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-28T04:09:57.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[9867]: audit 2021-01-28T04:09:55.907984+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:57.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[9867]: audit 2021-01-28T04:09:55.915860+0000 mon.a (mon.0) 426 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:57.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[9867]: audit 2021-01-28T04:09:55.965782+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:57.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[9867]: audit 2021-01-28T04:09:56.404306+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:57.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[9867]: audit 2021-01-28T04:09:56.416445+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:57.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[13629]: audit 2021-01-28T04:09:55.905426+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:57.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[13629]: audit 2021-01-28T04:09:55.906927+0000 mon.a (mon.0) 423 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-28T04:09:57.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[13629]: cluster 2021-01-28T04:09:55.907026+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-28T04:09:57.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[13629]: audit 2021-01-28T04:09:55.907984+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:57.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[13629]: audit 2021-01-28T04:09:55.915860+0000 mon.a (mon.0) 426 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:57.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[13629]: audit 2021-01-28T04:09:55.965782+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:57.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[13629]: audit 2021-01-28T04:09:56.404306+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:57.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:56 smithi150 bash[13629]: audit 2021-01-28T04:09:56.416445+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:57.384 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[15130]: debug 2021-01-28T04:09:56.920+0000 7fcdc693d700 -1 osd.5 0 waiting for initial osdmap 2021-01-28T04:09:57.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[9858]: audit 2021-01-28T04:09:55.905426+0000 mon.b (mon.2) 10 : audit [INF] from='osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:57.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[9858]: audit 2021-01-28T04:09:55.906927+0000 mon.a (mon.0) 423 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2021-01-28T04:09:57.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[9858]: cluster 2021-01-28T04:09:55.907026+0000 mon.a (mon.0) 424 : cluster [DBG] osdmap e34: 6 total, 5 up, 5 in 2021-01-28T04:09:57.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[9858]: audit 2021-01-28T04:09:55.907984+0000 mon.a (mon.0) 425 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:57.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[9858]: audit 2021-01-28T04:09:55.915860+0000 mon.a (mon.0) 426 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:09:57.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[9858]: audit 2021-01-28T04:09:55.965782+0000 mon.a (mon.0) 427 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:57.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[9858]: audit 2021-01-28T04:09:56.404306+0000 mon.a (mon.0) 428 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:57.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:56 smithi134 bash[9858]: audit 2021-01-28T04:09:56.416445+0000 mon.a (mon.0) 429 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:09:58.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[9867]: cephadm 2021-01-28T04:09:55.966931+0000 mgr.y (mgr.14138) 195 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:09:58.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[9867]: cephadm 2021-01-28T04:09:56.406035+0000 mgr.y (mgr.14138) 196 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:58.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[9867]: cephadm 2021-01-28T04:09:56.417732+0000 mgr.y (mgr.14138) 197 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:58.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[9867]: cluster 2021-01-28T04:09:56.831284+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:58.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[9867]: audit 2021-01-28T04:09:56.918154+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:09:58.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[9867]: cluster 2021-01-28T04:09:56.918377+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-28T04:09:58.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[9867]: audit 2021-01-28T04:09:56.919434+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:58.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[9867]: audit 2021-01-28T04:09:56.926905+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:58.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[13629]: cephadm 2021-01-28T04:09:55.966931+0000 mgr.y (mgr.14138) 195 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:09:58.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[13629]: cephadm 2021-01-28T04:09:56.406035+0000 mgr.y (mgr.14138) 196 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:58.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[13629]: cephadm 2021-01-28T04:09:56.417732+0000 mgr.y (mgr.14138) 197 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:58.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[13629]: cluster 2021-01-28T04:09:56.831284+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:58.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[13629]: audit 2021-01-28T04:09:56.918154+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:09:58.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[13629]: cluster 2021-01-28T04:09:56.918377+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-28T04:09:58.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[13629]: audit 2021-01-28T04:09:56.919434+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:58.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:57 smithi150 bash[13629]: audit 2021-01-28T04:09:56.926905+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:58.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:57 smithi134 bash[9858]: cephadm 2021-01-28T04:09:55.966931+0000 mgr.y (mgr.14138) 195 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:09:58.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:57 smithi134 bash[9858]: cephadm 2021-01-28T04:09:56.406035+0000 mgr.y (mgr.14138) 196 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:58.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:57 smithi134 bash[9858]: cephadm 2021-01-28T04:09:56.417732+0000 mgr.y (mgr.14138) 197 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:09:58.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:57 smithi134 bash[9858]: cluster 2021-01-28T04:09:56.831284+0000 mgr.y (mgr.14138) 198 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 25 MiB used, 447 GiB / 447 GiB avail 2021-01-28T04:09:58.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:57 smithi134 bash[9858]: audit 2021-01-28T04:09:56.918154+0000 mon.a (mon.0) 430 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:09:58.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:57 smithi134 bash[9858]: cluster 2021-01-28T04:09:56.918377+0000 mon.a (mon.0) 431 : cluster [DBG] osdmap e35: 6 total, 5 up, 5 in 2021-01-28T04:09:58.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:57 smithi134 bash[9858]: audit 2021-01-28T04:09:56.919434+0000 mon.a (mon.0) 432 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:58.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:57 smithi134 bash[9858]: audit 2021-01-28T04:09:56.926905+0000 mon.a (mon.0) 433 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:59.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: cluster 2021-01-28T04:09:56.353337+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:59.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: cluster 2021-01-28T04:09:56.353442+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:59.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: cluster 2021-01-28T04:09:57.926819+0000 mon.a (mon.0) 434 : cluster [INF] osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983] boot 2021-01-28T04:09:59.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: cluster 2021-01-28T04:09:57.927124+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-28T04:09:59.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: audit 2021-01-28T04:09:57.928403+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:59.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: audit 2021-01-28T04:09:58.329474+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:59.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: audit 2021-01-28T04:09:58.332936+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:59.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: audit 2021-01-28T04:09:58.334691+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:59.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:58 smithi134 bash[9858]: audit 2021-01-28T04:09:58.336753+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:59.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: cluster 2021-01-28T04:09:56.353337+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:59.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: cluster 2021-01-28T04:09:56.353442+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:59.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: cluster 2021-01-28T04:09:57.926819+0000 mon.a (mon.0) 434 : cluster [INF] osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983] boot 2021-01-28T04:09:59.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: cluster 2021-01-28T04:09:57.927124+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-28T04:09:59.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: audit 2021-01-28T04:09:57.928403+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:59.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: audit 2021-01-28T04:09:58.329474+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:59.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: audit 2021-01-28T04:09:58.332936+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:59.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: audit 2021-01-28T04:09:58.334691+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:59.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[9867]: audit 2021-01-28T04:09:58.336753+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:09:59.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: cluster 2021-01-28T04:09:56.353337+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:09:59.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: cluster 2021-01-28T04:09:56.353442+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:09:59.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: cluster 2021-01-28T04:09:57.926819+0000 mon.a (mon.0) 434 : cluster [INF] osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983] boot 2021-01-28T04:09:59.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: cluster 2021-01-28T04:09:57.927124+0000 mon.a (mon.0) 435 : cluster [DBG] osdmap e36: 6 total, 6 up, 6 in 2021-01-28T04:09:59.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: audit 2021-01-28T04:09:57.928403+0000 mon.a (mon.0) 436 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:09:59.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: audit 2021-01-28T04:09:58.329474+0000 mon.a (mon.0) 437 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:09:59.224 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: audit 2021-01-28T04:09:58.332936+0000 mon.a (mon.0) 438 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:09:59.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: audit 2021-01-28T04:09:58.334691+0000 mon.a (mon.0) 439 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:09:59.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:58 smithi150 bash[13629]: audit 2021-01-28T04:09:58.336753+0000 mon.a (mon.0) 440 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:00.100 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:59 smithi134 bash[9858]: audit 2021-01-28T04:09:58.327373+0000 mgr.y (mgr.14138) 199 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:10:00.100 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:59 smithi134 bash[9858]: cephadm 2021-01-28T04:09:58.332369+0000 mgr.y (mgr.14138) 200 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:10:00.100 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:59 smithi134 bash[9858]: cluster 2021-01-28T04:09:58.831881+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v165: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:00.100 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:09:59 smithi134 bash[9858]: cluster 2021-01-28T04:09:58.937256+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-28T04:10:00.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:59 smithi150 bash[13629]: audit 2021-01-28T04:09:58.327373+0000 mgr.y (mgr.14138) 199 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:10:00.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:59 smithi150 bash[13629]: cephadm 2021-01-28T04:09:58.332369+0000 mgr.y (mgr.14138) 200 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:10:00.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:59 smithi150 bash[13629]: cluster 2021-01-28T04:09:58.831881+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v165: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:00.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:09:59 smithi150 bash[13629]: cluster 2021-01-28T04:09:58.937256+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-28T04:10:00.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:59 smithi150 bash[9867]: audit 2021-01-28T04:09:58.327373+0000 mgr.y (mgr.14138) 199 : audit [DBG] from='client.34259 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:10:00.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:59 smithi150 bash[9867]: cephadm 2021-01-28T04:09:58.332369+0000 mgr.y (mgr.14138) 200 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:10:00.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:59 smithi150 bash[9867]: cluster 2021-01-28T04:09:58.831881+0000 mgr.y (mgr.14138) 201 : cluster [DBG] pgmap v165: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:00.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:09:59 smithi150 bash[9867]: cluster 2021-01-28T04:09:58.937256+0000 mon.a (mon.0) 441 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2021-01-28T04:10:01.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:00 smithi134 bash[9858]: cluster 2021-01-28T04:10:00.000162+0000 mon.a (mon.0) 442 : cluster [INF] overall HEALTH_OK 2021-01-28T04:10:01.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:00 smithi150 bash[13629]: cluster 2021-01-28T04:10:00.000162+0000 mon.a (mon.0) 442 : cluster [INF] overall HEALTH_OK 2021-01-28T04:10:01.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:00 smithi150 bash[9867]: cluster 2021-01-28T04:10:00.000162+0000 mon.a (mon.0) 442 : cluster [INF] overall HEALTH_OK 2021-01-28T04:10:02.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:01 smithi150 bash[13629]: cluster 2021-01-28T04:10:00.832427+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:02.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:01 smithi150 bash[9867]: cluster 2021-01-28T04:10:00.832427+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:02.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:01 smithi134 bash[9858]: cluster 2021-01-28T04:10:00.832427+0000 mgr.y (mgr.14138) 202 : cluster [DBG] pgmap v167: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:03.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[9867]: audit 2021-01-28T04:10:02.514803+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.134:0/2562160888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]: dispatch 2021-01-28T04:10:03.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[9867]: audit 2021-01-28T04:10:02.518937+0000 mon.a (mon.0) 443 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]: dispatch 2021-01-28T04:10:03.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[9867]: audit 2021-01-28T04:10:02.527589+0000 mon.a (mon.0) 444 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]': finished 2021-01-28T04:10:03.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[9867]: cluster 2021-01-28T04:10:02.527731+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-28T04:10:03.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[9867]: audit 2021-01-28T04:10:02.527990+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:03.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[9867]: cluster 2021-01-28T04:10:02.832970+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v169: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:03.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[13629]: audit 2021-01-28T04:10:02.514803+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.134:0/2562160888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]: dispatch 2021-01-28T04:10:03.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[13629]: audit 2021-01-28T04:10:02.518937+0000 mon.a (mon.0) 443 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]: dispatch 2021-01-28T04:10:03.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[13629]: audit 2021-01-28T04:10:02.527589+0000 mon.a (mon.0) 444 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]': finished 2021-01-28T04:10:03.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[13629]: cluster 2021-01-28T04:10:02.527731+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-28T04:10:03.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[13629]: audit 2021-01-28T04:10:02.527990+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:03.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:02 smithi150 bash[13629]: cluster 2021-01-28T04:10:02.832970+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v169: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:03.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:02 smithi134 bash[9858]: audit 2021-01-28T04:10:02.514803+0000 mon.b (mon.2) 11 : audit [INF] from='client.? 172.21.15.134:0/2562160888' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]: dispatch 2021-01-28T04:10:03.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:02 smithi134 bash[9858]: audit 2021-01-28T04:10:02.518937+0000 mon.a (mon.0) 443 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]: dispatch 2021-01-28T04:10:03.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:02 smithi134 bash[9858]: audit 2021-01-28T04:10:02.527589+0000 mon.a (mon.0) 444 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ba50ffef-fcbd-4944-8e0a-bf1c085192b4"}]': finished 2021-01-28T04:10:03.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:02 smithi134 bash[9858]: cluster 2021-01-28T04:10:02.527731+0000 mon.a (mon.0) 445 : cluster [DBG] osdmap e38: 7 total, 6 up, 6 in 2021-01-28T04:10:03.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:02 smithi134 bash[9858]: audit 2021-01-28T04:10:02.527990+0000 mon.a (mon.0) 446 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:03.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:02 smithi134 bash[9858]: cluster 2021-01-28T04:10:02.832970+0000 mgr.y (mgr.14138) 203 : cluster [DBG] pgmap v169: 1 pgs: 1 peering; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:04.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:03 smithi150 bash[9867]: audit 2021-01-28T04:10:03.186920+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.134:0/4252864930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:10:04.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:03 smithi150 bash[13629]: audit 2021-01-28T04:10:03.186920+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.134:0/4252864930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:10:04.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:03 smithi134 bash[9858]: audit 2021-01-28T04:10:03.186920+0000 mon.b (mon.2) 12 : audit [DBG] from='client.? 172.21.15.134:0/4252864930' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:10:05.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:04 smithi134 bash[9858]: cluster 2021-01-28T04:10:04.833598+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:05.467 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:04 smithi150 bash[9867]: cluster 2021-01-28T04:10:04.833598+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:05.468 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:04 smithi150 bash[13629]: cluster 2021-01-28T04:10:04.833598+0000 mgr.y (mgr.14138) 204 : cluster [DBG] pgmap v170: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:06.860 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:06 smithi134 bash[9858]: audit 2021-01-28T04:10:06.482729+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:06.967 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:06 smithi150 bash[9867]: audit 2021-01-28T04:10:06.482729+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:06.968 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:06 smithi150 bash[13629]: audit 2021-01-28T04:10:06.482729+0000 mon.a (mon.0) 447 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:07.884 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:07 smithi134 bash[9858]: cluster 2021-01-28T04:10:06.834190+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:07.967 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:07 smithi150 bash[9867]: cluster 2021-01-28T04:10:06.834190+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:07.967 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:07 smithi150 bash[13629]: cluster 2021-01-28T04:10:06.834190+0000 mgr.y (mgr.14138) 205 : cluster [DBG] pgmap v171: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:10.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:09 smithi134 bash[9858]: cluster 2021-01-28T04:10:08.834801+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:10.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:09 smithi150 bash[9867]: cluster 2021-01-28T04:10:08.834801+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:10.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:09 smithi150 bash[13629]: cluster 2021-01-28T04:10:08.834801+0000 mgr.y (mgr.14138) 206 : cluster [DBG] pgmap v172: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:12.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:11 smithi150 bash[9867]: cluster 2021-01-28T04:10:10.835375+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:12.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:11 smithi150 bash[9867]: audit 2021-01-28T04:10:11.060985+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-28T04:10:12.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:11 smithi150 bash[9867]: audit 2021-01-28T04:10:11.062844+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:12.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:11 smithi150 bash[9867]: audit 2021-01-28T04:10:11.065115+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-28T04:10:12.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:11 smithi150 bash[13629]: cluster 2021-01-28T04:10:10.835375+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:12.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:11 smithi150 bash[13629]: audit 2021-01-28T04:10:11.060985+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-28T04:10:12.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:11 smithi150 bash[13629]: audit 2021-01-28T04:10:11.062844+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:12.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:11 smithi150 bash[13629]: audit 2021-01-28T04:10:11.065115+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-28T04:10:12.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:11 smithi134 bash[9858]: cluster 2021-01-28T04:10:10.835375+0000 mgr.y (mgr.14138) 207 : cluster [DBG] pgmap v173: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:12.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:11 smithi134 bash[9858]: audit 2021-01-28T04:10:11.060985+0000 mon.a (mon.0) 448 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2021-01-28T04:10:12.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:11 smithi134 bash[9858]: audit 2021-01-28T04:10:11.062844+0000 mon.a (mon.0) 449 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:12.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:11 smithi134 bash[9858]: audit 2021-01-28T04:10:11.065115+0000 mon.a (mon.0) 450 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.6", "key": "container_image"}]: dispatch 2021-01-28T04:10:13.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:12 smithi134 bash[9858]: cephadm 2021-01-28T04:10:11.064313+0000 mgr.y (mgr.14138) 208 : cephadm [INF] Deploying daemon osd.6 on smithi134 2021-01-28T04:10:13.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:12 smithi150 bash[9867]: cephadm 2021-01-28T04:10:11.064313+0000 mgr.y (mgr.14138) 208 : cephadm [INF] Deploying daemon osd.6 on smithi134 2021-01-28T04:10:13.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:12 smithi150 bash[13629]: cephadm 2021-01-28T04:10:11.064313+0000 mgr.y (mgr.14138) 208 : cephadm [INF] Deploying daemon osd.6 on smithi134 2021-01-28T04:10:13.862 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 6 on host 'smithi134' 2021-01-28T04:10:13.944 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:13 smithi134 bash[9858]: cluster 2021-01-28T04:10:12.835938+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:13.944 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:13 smithi134 bash[9858]: audit 2021-01-28T04:10:13.860636+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:13.945 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:13 smithi134 bash[9858]: audit 2021-01-28T04:10:13.866248+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:14.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:13 smithi150 bash[9867]: cluster 2021-01-28T04:10:12.835938+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:14.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:13 smithi150 bash[9867]: audit 2021-01-28T04:10:13.860636+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:14.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:13 smithi150 bash[9867]: audit 2021-01-28T04:10:13.866248+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:14.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:13 smithi150 bash[13629]: cluster 2021-01-28T04:10:12.835938+0000 mgr.y (mgr.14138) 209 : cluster [DBG] pgmap v174: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:14.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:13 smithi150 bash[13629]: audit 2021-01-28T04:10:13.860636+0000 mon.a (mon.0) 451 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:14.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:13 smithi150 bash[13629]: audit 2021-01-28T04:10:13.866248+0000 mon.a (mon.0) 452 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:15.318 DEBUG:teuthology.orchestra.run.smithi134:osd.6> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@osd.6.service 2021-01-28T04:10:15.320 INFO:tasks.cephadm:Deploying osd.7 on smithi134 with /dev/vg_nvme/lv_1... 2021-01-28T04:10:15.321 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2021-01-28T04:10:15.455 INFO:journalctl@ceph.osd.6.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:10:16.133 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:15 smithi134 bash[9858]: audit 2021-01-28T04:10:14.807529+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:16.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:15 smithi134 bash[9858]: audit 2021-01-28T04:10:14.809641+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:16.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:15 smithi134 bash[9858]: cluster 2021-01-28T04:10:14.836512+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:16.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:15 smithi150 bash[9867]: audit 2021-01-28T04:10:14.807529+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:16.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:15 smithi150 bash[9867]: audit 2021-01-28T04:10:14.809641+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:16.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:15 smithi150 bash[9867]: cluster 2021-01-28T04:10:14.836512+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:16.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:15 smithi150 bash[13629]: audit 2021-01-28T04:10:14.807529+0000 mon.a (mon.0) 453 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:16.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:15 smithi150 bash[13629]: audit 2021-01-28T04:10:14.809641+0000 mon.a (mon.0) 454 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:16.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:15 smithi150 bash[13629]: cluster 2021-01-28T04:10:14.836512+0000 mgr.y (mgr.14138) 210 : cluster [DBG] pgmap v175: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:16.820 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:16 smithi134 bash[17323]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-28T04:10:16.820 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:16 smithi134 bash[17323]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-6 --no-mon-config 2021-01-28T04:10:16.821 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:16 smithi134 bash[17323]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6/block 2021-01-28T04:10:16.821 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:16 smithi134 bash[17323]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-6/block 2021-01-28T04:10:16.821 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:16 smithi134 bash[17323]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2021-01-28T04:10:16.821 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:16 smithi134 bash[17323]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2021-01-28T04:10:16.822 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:16 smithi134 bash[17323]: --> ceph-volume lvm activate successful for osd ID: 6 2021-01-28T04:10:17.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:16 smithi134 bash[9858]: audit 2021-01-28T04:10:15.949705+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:17.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:16 smithi150 bash[9867]: audit 2021-01-28T04:10:15.949705+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:17.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:16 smithi150 bash[13629]: audit 2021-01-28T04:10:15.949705+0000 mon.a (mon.0) 455 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:18.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:17 smithi134 bash[9858]: cluster 2021-01-28T04:10:16.837146+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:18.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:17 smithi150 bash[9867]: cluster 2021-01-28T04:10:16.837146+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:18.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:17 smithi150 bash[13629]: cluster 2021-01-28T04:10:16.837146+0000 mgr.y (mgr.14138) 211 : cluster [DBG] pgmap v176: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:19.284 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:19 smithi134 bash[9858]: cluster 2021-01-28T04:10:18.837788+0000 mgr.y (mgr.14138) 212 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:19.467 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:19 smithi150 bash[13629]: cluster 2021-01-28T04:10:18.837788+0000 mgr.y (mgr.14138) 212 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:19.467 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:19 smithi150 bash[9867]: cluster 2021-01-28T04:10:18.837788+0000 mgr.y (mgr.14138) 212 : cluster [DBG] pgmap v177: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:21.634 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 -- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 msgr2=0x555619661400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T04:10:23.357 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 -- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 msgr2=0x555619661400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T04:10:23.357 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).handle_read_frame_preamble_main r=0 2021-01-28T04:10:23.357 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_MESSAGE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).throttle_message 2021-01-28T04:10:23.358 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_BYTES pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).throttle_bytes 2021-01-28T04:10:23.358 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).throttle_dispatch_queue 2021-01-28T04:10:23.358 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).read_frame_segment seg_idx=0 2021-01-28T04:10:23.359 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).read_frame_segment seg_idx=1 2021-01-28T04:10:23.359 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 -- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 msgr2=0x555619661400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T04:10:23.359 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).handle_read_frame_segment r=0 2021-01-28T04:10:23.360 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 -- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 msgr2=0x555619661400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T04:10:23.360 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).handle_read_frame_epilogue_main r=0 2021-01-28T04:10:23.360 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 10 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).handle_read_frame_dispatch tag=17 2021-01-28T04:10:23.360 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).handle_message 2021-01-28T04:10:23.360 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 5 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-28T04:10:23.361 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 5 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).handle_message received message m=0x5556196764e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T04:10:23.361 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 -- 172.21.15.134:0/2178820285 queue 0x5556196764e0 prio 196 2021-01-28T04:10:23.361 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 --2- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 0x555619661400 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x555619671e60 tx=0x5556196a6d80).read_frame 2021-01-28T04:10:23.361 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865d0db700 20 -- 172.21.15.134:0/2178820285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556196f4c00 msgr2=0x555619661400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T04:10:23.361 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865c0d9700 1 -- 172.21.15.134:0/2178820285 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5556196764e0 con 0x5556196f4c00 2021-01-28T04:10:23.362 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865c0d9700 10 -- 172.21.15.134:0/2178820285 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T04:10:23.362 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.452+0000 7f865c0d9700 20 -- 172.21.15.134:0/2178820285 done calling dispatch on 0x5556196764e0 2021-01-28T04:10:23.363 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:21 smithi150 bash[9867]: cluster 2021-01-28T04:10:20.838334+0000 mgr.y (mgr.14138) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:23.363 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:21 smithi150 bash[9867]: audit 2021-01-28T04:10:20.948392+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:10:23.363 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:21 smithi150 bash[9867]: audit 2021-01-28T04:10:20.952655+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:10:23.364 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:21 smithi150 bash[13629]: cluster 2021-01-28T04:10:20.838334+0000 mgr.y (mgr.14138) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:23.364 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:21 smithi150 bash[13629]: audit 2021-01-28T04:10:20.948392+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:10:23.364 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:21 smithi150 bash[13629]: audit 2021-01-28T04:10:20.952655+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:10:23.364 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[17716]: debug 2021-01-28T04:10:21.760+0000 7f8663b64200 -1 Falling back to public interface 2021-01-28T04:10:23.365 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[9858]: cluster 2021-01-28T04:10:20.838334+0000 mgr.y (mgr.14138) 213 : cluster [DBG] pgmap v178: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:23.365 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[9858]: audit 2021-01-28T04:10:20.948392+0000 mon.a (mon.0) 456 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:10:23.365 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:21 smithi134 bash[9858]: audit 2021-01-28T04:10:20.952655+0000 mon.a (mon.0) 457 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:10:23.365 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_1 2021-01-28T04:10:23.366 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2021-01-28T04:10:23.366 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2021-01-28T04:10:23.366 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2021-01-28T04:10:23.366 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0209954 s, 499 MB/s 2021-01-28T04:10:23.367 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2021-01-28T04:10:24.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:23 smithi150 bash[9867]: cluster 2021-01-28T04:10:22.838929+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:24.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:23 smithi150 bash[13629]: cluster 2021-01-28T04:10:22.838929+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:24.222 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:23 smithi134 bash[9858]: cluster 2021-01-28T04:10:22.838929+0000 mgr.y (mgr.14138) 214 : cluster [DBG] pgmap v179: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:24.337 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch daemon add osd smithi134:vg_nvme/lv_1 2021-01-28T04:10:25.134 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:24 smithi134 bash[17716]: debug 2021-01-28T04:10:24.788+0000 7f8663b64200 -1 osd.6 0 log_to_monitors {default=true} 2021-01-28T04:10:25.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:24 smithi134 bash[9858]: audit 2021-01-28T04:10:24.800638+0000 mon.c (mon.1) 12 : audit [INF] from='osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T04:10:25.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:24 smithi134 bash[9858]: audit 2021-01-28T04:10:24.801464+0000 mon.a (mon.0) 458 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T04:10:25.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:24 smithi150 bash[9867]: audit 2021-01-28T04:10:24.800638+0000 mon.c (mon.1) 12 : audit [INF] from='osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T04:10:25.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:24 smithi150 bash[9867]: audit 2021-01-28T04:10:24.801464+0000 mon.a (mon.0) 458 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T04:10:25.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:24 smithi150 bash[13629]: audit 2021-01-28T04:10:24.800638+0000 mon.c (mon.1) 12 : audit [INF] from='osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T04:10:25.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:24 smithi150 bash[13629]: audit 2021-01-28T04:10:24.801464+0000 mon.a (mon.0) 458 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2021-01-28T04:10:26.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: cluster 2021-01-28T04:10:24.839503+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:26.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: audit 2021-01-28T04:10:24.915634+0000 mon.a (mon.0) 459 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-28T04:10:26.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: cluster 2021-01-28T04:10:24.915788+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-28T04:10:26.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: audit 2021-01-28T04:10:24.915980+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:26.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: audit 2021-01-28T04:10:24.917311+0000 mon.c (mon.1) 13 : audit [INF] from='osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:26.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: audit 2021-01-28T04:10:24.917817+0000 mon.a (mon.0) 462 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:26.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: audit 2021-01-28T04:10:25.358225+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:26.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: audit 2021-01-28T04:10:25.739197+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:26.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[9867]: audit 2021-01-28T04:10:25.746749+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:26.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: cluster 2021-01-28T04:10:24.839503+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:26.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: audit 2021-01-28T04:10:24.915634+0000 mon.a (mon.0) 459 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-28T04:10:26.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: cluster 2021-01-28T04:10:24.915788+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-28T04:10:26.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: audit 2021-01-28T04:10:24.915980+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:26.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: audit 2021-01-28T04:10:24.917311+0000 mon.c (mon.1) 13 : audit [INF] from='osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:26.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: audit 2021-01-28T04:10:24.917817+0000 mon.a (mon.0) 462 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:26.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: audit 2021-01-28T04:10:25.358225+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:26.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: audit 2021-01-28T04:10:25.739197+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:26.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:25 smithi150 bash[13629]: audit 2021-01-28T04:10:25.746749+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:26.224 INFO:journalctl@ceph.osd.6.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[17716]: debug 2021-01-28T04:10:25.928+0000 7f865a0d5700 -1 osd.6 0 waiting for initial osdmap 2021-01-28T04:10:26.224 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: cluster 2021-01-28T04:10:24.839503+0000 mgr.y (mgr.14138) 215 : cluster [DBG] pgmap v180: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:26.224 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: audit 2021-01-28T04:10:24.915634+0000 mon.a (mon.0) 459 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2021-01-28T04:10:26.225 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: cluster 2021-01-28T04:10:24.915788+0000 mon.a (mon.0) 460 : cluster [DBG] osdmap e39: 7 total, 6 up, 6 in 2021-01-28T04:10:26.225 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: audit 2021-01-28T04:10:24.915980+0000 mon.a (mon.0) 461 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:26.225 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: audit 2021-01-28T04:10:24.917311+0000 mon.c (mon.1) 13 : audit [INF] from='osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:26.225 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: audit 2021-01-28T04:10:24.917817+0000 mon.a (mon.0) 462 : audit [INF] from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:26.225 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: audit 2021-01-28T04:10:25.358225+0000 mon.a (mon.0) 463 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:26.226 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: audit 2021-01-28T04:10:25.739197+0000 mon.a (mon.0) 464 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:26.226 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:25 smithi134 bash[9858]: audit 2021-01-28T04:10:25.746749+0000 mon.a (mon.0) 465 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:27.133 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:26 smithi134 bash[9858]: cephadm 2021-01-28T04:10:25.748477+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:27.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:26 smithi134 bash[9858]: cephadm 2021-01-28T04:10:25.751341+0000 mgr.y (mgr.14138) 217 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:10:27.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:26 smithi134 bash[9858]: audit 2021-01-28T04:10:25.921455+0000 mon.a (mon.0) 466 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:10:27.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:26 smithi134 bash[9858]: cluster 2021-01-28T04:10:25.921685+0000 mon.a (mon.0) 467 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-28T04:10:27.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:26 smithi134 bash[9858]: audit 2021-01-28T04:10:25.922316+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:27.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:26 smithi134 bash[9858]: audit 2021-01-28T04:10:25.934221+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:27.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:26 smithi134 bash[9858]: audit 2021-01-28T04:10:26.182739+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:27.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[9867]: cephadm 2021-01-28T04:10:25.748477+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:27.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[9867]: cephadm 2021-01-28T04:10:25.751341+0000 mgr.y (mgr.14138) 217 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:10:27.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[9867]: audit 2021-01-28T04:10:25.921455+0000 mon.a (mon.0) 466 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:10:27.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[9867]: cluster 2021-01-28T04:10:25.921685+0000 mon.a (mon.0) 467 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-28T04:10:27.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[9867]: audit 2021-01-28T04:10:25.922316+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:27.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[9867]: audit 2021-01-28T04:10:25.934221+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:27.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[9867]: audit 2021-01-28T04:10:26.182739+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:27.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[13629]: cephadm 2021-01-28T04:10:25.748477+0000 mgr.y (mgr.14138) 216 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:27.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[13629]: cephadm 2021-01-28T04:10:25.751341+0000 mgr.y (mgr.14138) 217 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:10:27.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[13629]: audit 2021-01-28T04:10:25.921455+0000 mon.a (mon.0) 466 : audit [INF] from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:10:27.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[13629]: cluster 2021-01-28T04:10:25.921685+0000 mon.a (mon.0) 467 : cluster [DBG] osdmap e40: 7 total, 6 up, 6 in 2021-01-28T04:10:27.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[13629]: audit 2021-01-28T04:10:25.922316+0000 mon.a (mon.0) 468 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:27.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[13629]: audit 2021-01-28T04:10:25.934221+0000 mon.a (mon.0) 469 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:27.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:26 smithi150 bash[13629]: audit 2021-01-28T04:10:26.182739+0000 mon.a (mon.0) 470 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:28.133 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:27 smithi134 bash[9858]: cluster 2021-01-28T04:10:25.745993+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:10:28.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:27 smithi134 bash[9858]: cluster 2021-01-28T04:10:25.746143+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:10:28.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:27 smithi134 bash[9858]: cephadm 2021-01-28T04:10:26.184412+0000 mgr.y (mgr.14138) 218 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:28.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:27 smithi134 bash[9858]: cluster 2021-01-28T04:10:26.839999+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:28.134 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:27 smithi134 bash[9858]: audit 2021-01-28T04:10:26.934934+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:28.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:27 smithi134 bash[9858]: cluster 2021-01-28T04:10:26.939934+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950] boot 2021-01-28T04:10:28.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:27 smithi134 bash[9858]: cluster 2021-01-28T04:10:26.939991+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-28T04:10:28.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:27 smithi134 bash[9858]: audit 2021-01-28T04:10:26.940236+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:28.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[9867]: cluster 2021-01-28T04:10:25.745993+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:10:28.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[9867]: cluster 2021-01-28T04:10:25.746143+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:10:28.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[9867]: cephadm 2021-01-28T04:10:26.184412+0000 mgr.y (mgr.14138) 218 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:28.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[9867]: cluster 2021-01-28T04:10:26.839999+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:28.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[9867]: audit 2021-01-28T04:10:26.934934+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:28.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[9867]: cluster 2021-01-28T04:10:26.939934+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950] boot 2021-01-28T04:10:28.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[9867]: cluster 2021-01-28T04:10:26.939991+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-28T04:10:28.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[9867]: audit 2021-01-28T04:10:26.940236+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:28.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[13629]: cluster 2021-01-28T04:10:25.745993+0000 osd.6 (osd.6) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:10:28.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[13629]: cluster 2021-01-28T04:10:25.746143+0000 osd.6 (osd.6) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:10:28.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[13629]: cephadm 2021-01-28T04:10:26.184412+0000 mgr.y (mgr.14138) 218 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:28.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[13629]: cluster 2021-01-28T04:10:26.839999+0000 mgr.y (mgr.14138) 219 : cluster [DBG] pgmap v183: 1 pgs: 1 active+clean; 0 B data, 30 MiB used, 536 GiB / 536 GiB avail 2021-01-28T04:10:28.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[13629]: audit 2021-01-28T04:10:26.934934+0000 mon.a (mon.0) 471 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:28.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[13629]: cluster 2021-01-28T04:10:26.939934+0000 mon.a (mon.0) 472 : cluster [INF] osd.6 [v2:172.21.15.134:6816/1369484950,v1:172.21.15.134:6817/1369484950] boot 2021-01-28T04:10:28.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[13629]: cluster 2021-01-28T04:10:26.939991+0000 mon.a (mon.0) 473 : cluster [DBG] osdmap e41: 7 total, 7 up, 7 in 2021-01-28T04:10:28.223 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:27 smithi150 bash[13629]: audit 2021-01-28T04:10:26.940236+0000 mon.a (mon.0) 474 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2021-01-28T04:10:29.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[9867]: cluster 2021-01-28T04:10:27.949321+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-28T04:10:29.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[9867]: audit 2021-01-28T04:10:28.234343+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:10:29.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[9867]: audit 2021-01-28T04:10:28.237823+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:10:29.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[9867]: audit 2021-01-28T04:10:28.239570+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:29.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[9867]: audit 2021-01-28T04:10:28.241677+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:29.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[13629]: cluster 2021-01-28T04:10:27.949321+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-28T04:10:29.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[13629]: audit 2021-01-28T04:10:28.234343+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:10:29.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[13629]: audit 2021-01-28T04:10:28.237823+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:10:29.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[13629]: audit 2021-01-28T04:10:28.239570+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:29.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:28 smithi150 bash[13629]: audit 2021-01-28T04:10:28.241677+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:29.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:28 smithi134 bash[9858]: cluster 2021-01-28T04:10:27.949321+0000 mon.a (mon.0) 475 : cluster [DBG] osdmap e42: 7 total, 7 up, 7 in 2021-01-28T04:10:29.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:28 smithi134 bash[9858]: audit 2021-01-28T04:10:28.234343+0000 mon.a (mon.0) 476 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2021-01-28T04:10:29.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:28 smithi134 bash[9858]: audit 2021-01-28T04:10:28.237823+0000 mon.a (mon.0) 477 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2021-01-28T04:10:29.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:28 smithi134 bash[9858]: audit 2021-01-28T04:10:28.239570+0000 mon.a (mon.0) 478 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:29.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:28 smithi134 bash[9858]: audit 2021-01-28T04:10:28.241677+0000 mon.a (mon.0) 479 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:30.045 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:29 smithi134 bash[9858]: audit 2021-01-28T04:10:28.232285+0000 mgr.y (mgr.14138) 220 : audit [DBG] from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:10:30.046 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:29 smithi134 bash[9858]: cephadm 2021-01-28T04:10:28.237270+0000 mgr.y (mgr.14138) 221 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:10:30.046 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:29 smithi134 bash[9858]: cluster 2021-01-28T04:10:28.840587+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v186: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:30.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:29 smithi150 bash[9867]: audit 2021-01-28T04:10:28.232285+0000 mgr.y (mgr.14138) 220 : audit [DBG] from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:10:30.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:29 smithi150 bash[9867]: cephadm 2021-01-28T04:10:28.237270+0000 mgr.y (mgr.14138) 221 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:10:30.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:29 smithi150 bash[9867]: cluster 2021-01-28T04:10:28.840587+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v186: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:30.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:29 smithi150 bash[13629]: audit 2021-01-28T04:10:28.232285+0000 mgr.y (mgr.14138) 220 : audit [DBG] from='client.34286 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:10:30.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:29 smithi150 bash[13629]: cephadm 2021-01-28T04:10:28.237270+0000 mgr.y (mgr.14138) 221 : cephadm [INF] Applying drive group None on host smithi134... 2021-01-28T04:10:30.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:29 smithi150 bash[13629]: cluster 2021-01-28T04:10:28.840587+0000 mgr.y (mgr.14138) 222 : cluster [DBG] pgmap v186: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:32.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:31 smithi150 bash[9867]: cluster 2021-01-28T04:10:30.841186+0000 mgr.y (mgr.14138) 223 : cluster [DBG] pgmap v187: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:32.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:31 smithi150 bash[13629]: cluster 2021-01-28T04:10:30.841186+0000 mgr.y (mgr.14138) 223 : cluster [DBG] pgmap v187: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:32.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:31 smithi134 bash[9858]: cluster 2021-01-28T04:10:30.841186+0000 mgr.y (mgr.14138) 223 : cluster [DBG] pgmap v187: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:33.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[9867]: audit 2021-01-28T04:10:32.481225+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.134:0/426340461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]: dispatch 2021-01-28T04:10:33.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[9867]: audit 2021-01-28T04:10:32.485307+0000 mon.a (mon.0) 480 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]: dispatch 2021-01-28T04:10:33.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[9867]: audit 2021-01-28T04:10:32.498002+0000 mon.a (mon.0) 481 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]': finished 2021-01-28T04:10:33.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[9867]: cluster 2021-01-28T04:10:32.498196+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-28T04:10:33.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[9867]: audit 2021-01-28T04:10:32.498538+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:33.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[9867]: cluster 2021-01-28T04:10:32.841783+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:33.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[13629]: audit 2021-01-28T04:10:32.481225+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.134:0/426340461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]: dispatch 2021-01-28T04:10:33.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[13629]: audit 2021-01-28T04:10:32.485307+0000 mon.a (mon.0) 480 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]: dispatch 2021-01-28T04:10:33.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[13629]: audit 2021-01-28T04:10:32.498002+0000 mon.a (mon.0) 481 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]': finished 2021-01-28T04:10:33.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[13629]: cluster 2021-01-28T04:10:32.498196+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-28T04:10:33.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[13629]: audit 2021-01-28T04:10:32.498538+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:33.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:32 smithi150 bash[13629]: cluster 2021-01-28T04:10:32.841783+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:33.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:32 smithi134 bash[9858]: audit 2021-01-28T04:10:32.481225+0000 mon.b (mon.2) 13 : audit [INF] from='client.? 172.21.15.134:0/426340461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]: dispatch 2021-01-28T04:10:33.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:32 smithi134 bash[9858]: audit 2021-01-28T04:10:32.485307+0000 mon.a (mon.0) 480 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]: dispatch 2021-01-28T04:10:33.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:32 smithi134 bash[9858]: audit 2021-01-28T04:10:32.498002+0000 mon.a (mon.0) 481 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "6817eafa-ca23-4efe-a5fa-b83d5c6f387a"}]': finished 2021-01-28T04:10:33.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:32 smithi134 bash[9858]: cluster 2021-01-28T04:10:32.498196+0000 mon.a (mon.0) 482 : cluster [DBG] osdmap e43: 8 total, 7 up, 7 in 2021-01-28T04:10:33.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:32 smithi134 bash[9858]: audit 2021-01-28T04:10:32.498538+0000 mon.a (mon.0) 483 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:33.385 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:32 smithi134 bash[9858]: cluster 2021-01-28T04:10:32.841783+0000 mgr.y (mgr.14138) 224 : cluster [DBG] pgmap v189: 1 pgs: 1 peering; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:34.217 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:33 smithi150 bash[9867]: audit 2021-01-28T04:10:33.150236+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.134:0/1719249403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:10:34.217 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:33 smithi150 bash[13629]: audit 2021-01-28T04:10:33.150236+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.134:0/1719249403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:10:34.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:33 smithi134 bash[9858]: audit 2021-01-28T04:10:33.150236+0000 mon.b (mon.2) 14 : audit [DBG] from='client.? 172.21.15.134:0/1719249403' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2021-01-28T04:10:35.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:34 smithi134 bash[9858]: cluster 2021-01-28T04:10:34.842377+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:35.467 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:34 smithi150 bash[9867]: cluster 2021-01-28T04:10:34.842377+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:35.468 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:34 smithi150 bash[13629]: cluster 2021-01-28T04:10:34.842377+0000 mgr.y (mgr.14138) 225 : cluster [DBG] pgmap v190: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:36.717 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:36 smithi150 bash[9867]: audit 2021-01-28T04:10:36.393418+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:36.718 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:36 smithi150 bash[13629]: audit 2021-01-28T04:10:36.393418+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:36.770 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:36 smithi134 bash[9858]: audit 2021-01-28T04:10:36.393418+0000 mon.a (mon.0) 484 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:37.879 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:37 smithi134 bash[9858]: cluster 2021-01-28T04:10:36.842938+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:37.968 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:37 smithi150 bash[9867]: cluster 2021-01-28T04:10:36.842938+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:37.969 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:37 smithi150 bash[13629]: cluster 2021-01-28T04:10:36.842938+0000 mgr.y (mgr.14138) 226 : cluster [DBG] pgmap v191: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:40.133 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:39 smithi134 bash[9858]: cluster 2021-01-28T04:10:38.843513+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:40.218 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:39 smithi150 bash[9867]: cluster 2021-01-28T04:10:38.843513+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:40.218 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:39 smithi150 bash[13629]: cluster 2021-01-28T04:10:38.843513+0000 mgr.y (mgr.14138) 227 : cluster [DBG] pgmap v192: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:42.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:41 smithi150 bash[9867]: cluster 2021-01-28T04:10:40.844097+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:42.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:41 smithi150 bash[9867]: audit 2021-01-28T04:10:41.179656+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-28T04:10:42.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:41 smithi150 bash[9867]: audit 2021-01-28T04:10:41.181400+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:42.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:41 smithi150 bash[9867]: audit 2021-01-28T04:10:41.183731+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-28T04:10:42.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:41 smithi150 bash[13629]: cluster 2021-01-28T04:10:40.844097+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:42.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:41 smithi150 bash[13629]: audit 2021-01-28T04:10:41.179656+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-28T04:10:42.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:41 smithi150 bash[13629]: audit 2021-01-28T04:10:41.181400+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:42.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:41 smithi150 bash[13629]: audit 2021-01-28T04:10:41.183731+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-28T04:10:42.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:41 smithi134 bash[9858]: cluster 2021-01-28T04:10:40.844097+0000 mgr.y (mgr.14138) 228 : cluster [DBG] pgmap v193: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:42.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:41 smithi134 bash[9858]: audit 2021-01-28T04:10:41.179656+0000 mon.a (mon.0) 485 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2021-01-28T04:10:42.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:41 smithi134 bash[9858]: audit 2021-01-28T04:10:41.181400+0000 mon.a (mon.0) 486 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:10:42.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:41 smithi134 bash[9858]: audit 2021-01-28T04:10:41.183731+0000 mon.a (mon.0) 487 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd.7", "key": "container_image"}]: dispatch 2021-01-28T04:10:43.133 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:42 smithi134 bash[9858]: cephadm 2021-01-28T04:10:41.182826+0000 mgr.y (mgr.14138) 229 : cephadm [INF] Deploying daemon osd.7 on smithi134 2021-01-28T04:10:43.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:42 smithi150 bash[9867]: cephadm 2021-01-28T04:10:41.182826+0000 mgr.y (mgr.14138) 229 : cephadm [INF] Deploying daemon osd.7 on smithi134 2021-01-28T04:10:43.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:42 smithi150 bash[13629]: cephadm 2021-01-28T04:10:41.182826+0000 mgr.y (mgr.14138) 229 : cephadm [INF] Deploying daemon osd.7 on smithi134 2021-01-28T04:10:44.013 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 7 on host 'smithi134' 2021-01-28T04:10:44.072 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:43 smithi134 bash[9858]: cluster 2021-01-28T04:10:42.844675+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:44.219 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:43 smithi150 bash[9867]: cluster 2021-01-28T04:10:42.844675+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:44.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:43 smithi150 bash[13629]: cluster 2021-01-28T04:10:42.844675+0000 mgr.y (mgr.14138) 230 : cluster [DBG] pgmap v194: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:45.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:44 smithi150 bash[13629]: audit 2021-01-28T04:10:44.009743+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:45.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:44 smithi150 bash[13629]: audit 2021-01-28T04:10:44.016937+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:45.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:44 smithi150 bash[9867]: audit 2021-01-28T04:10:44.009743+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:45.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:44 smithi150 bash[9867]: audit 2021-01-28T04:10:44.016937+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:45.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:44 smithi134 bash[9858]: audit 2021-01-28T04:10:44.009743+0000 mon.a (mon.0) 488 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:45.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:44 smithi134 bash[9858]: audit 2021-01-28T04:10:44.016937+0000 mon.a (mon.0) 489 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:45.890 DEBUG:teuthology.orchestra.run.smithi134:osd.7> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@osd.7.service 2021-01-28T04:10:45.897 INFO:tasks.cephadm:Adding ceph.rgw.realm.zone.a on smithi150 2021-01-28T04:10:45.898 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- radosgw-admin realm create --rgw-realm realm --default 2021-01-28T04:10:45.937 INFO:journalctl@ceph.osd.7.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:10:46.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:45 smithi150 bash[13629]: cluster 2021-01-28T04:10:44.845340+0000 mgr.y (mgr.14138) 231 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:46.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:45 smithi150 bash[13629]: audit 2021-01-28T04:10:45.142689+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:46.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:45 smithi150 bash[13629]: audit 2021-01-28T04:10:45.144687+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:46.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:45 smithi150 bash[9867]: cluster 2021-01-28T04:10:44.845340+0000 mgr.y (mgr.14138) 231 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:46.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:45 smithi150 bash[9867]: audit 2021-01-28T04:10:45.142689+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:46.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:45 smithi150 bash[9867]: audit 2021-01-28T04:10:45.144687+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:46.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:45 smithi134 bash[9858]: cluster 2021-01-28T04:10:44.845340+0000 mgr.y (mgr.14138) 231 : cluster [DBG] pgmap v195: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:46.383 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:45 smithi134 bash[9858]: audit 2021-01-28T04:10:45.142689+0000 mon.a (mon.0) 490 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:46.384 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:45 smithi134 bash[9858]: audit 2021-01-28T04:10:45.144687+0000 mon.a (mon.0) 491 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "osd", "key": "container_image"}]: dispatch 2021-01-28T04:10:47.114 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:46 smithi134 bash[9858]: audit 2021-01-28T04:10:45.958104+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:47.219 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:46 smithi150 bash[13629]: audit 2021-01-28T04:10:45.958104+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:47.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:46 smithi150 bash[9867]: audit 2021-01-28T04:10:45.958104+0000 mon.a (mon.0) 492 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:47.402 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:47 smithi134 bash[19844]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-28T04:10:47.403 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:47 smithi134 bash[19844]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_1 --path /var/lib/ceph/osd/ceph-7 --no-mon-config 2021-01-28T04:10:47.403 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:47 smithi134 bash[19844]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-7/block 2021-01-28T04:10:47.403 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:47 smithi134 bash[19844]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-7/block 2021-01-28T04:10:47.403 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:47 smithi134 bash[19844]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-0 2021-01-28T04:10:47.403 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:47 smithi134 bash[19844]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2021-01-28T04:10:47.404 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:47 smithi134 bash[19844]: --> ceph-volume lvm activate successful for osd ID: 7 2021-01-28T04:10:48.133 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:47 smithi134 bash[9858]: cluster 2021-01-28T04:10:46.845909+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:48.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:47 smithi150 bash[9867]: cluster 2021-01-28T04:10:46.845909+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:48.220 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:47 smithi150 bash[13629]: cluster 2021-01-28T04:10:46.845909+0000 mgr.y (mgr.14138) 232 : cluster [DBG] pgmap v196: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:49.220 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:48 smithi150 bash[9867]: cluster 2021-01-28T04:10:48.846506+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:49.221 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:48 smithi150 bash[13629]: cluster 2021-01-28T04:10:48.846506+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:49.310 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:48 smithi134 bash[9858]: cluster 2021-01-28T04:10:48.846506+0000 mgr.y (mgr.14138) 233 : cluster [DBG] pgmap v197: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:52.215 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:51 smithi134 bash[9858]: cluster 2021-01-28T04:10:50.847065+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:52.216 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 -- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 msgr2=0x5616ef99f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).process 2021-01-28T04:10:52.216 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 -- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 msgr2=0x5616ef99f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read continue len=96 2021-01-28T04:10:52.217 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).handle_read_frame_preamble_main r=0 2021-01-28T04:10:52.217 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_MESSAGE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).throttle_message 2021-01-28T04:10:52.217 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_BYTES pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).throttle_bytes 2021-01-28T04:10:52.217 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_DISPATCH_QUEUE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).throttle_dispatch_queue 2021-01-28T04:10:52.217 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).read_frame_segment seg_idx=0 2021-01-28T04:10:52.218 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).read_frame_segment seg_idx=1 2021-01-28T04:10:52.218 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 -- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 msgr2=0x5616ef99f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=208 2021-01-28T04:10:52.218 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).handle_read_frame_segment r=0 2021-01-28T04:10:52.218 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 -- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 msgr2=0x5616ef99f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=32 2021-01-28T04:10:52.219 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).handle_read_frame_epilogue_main r=0 2021-01-28T04:10:52.219 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 10 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).handle_read_frame_dispatch tag=17 2021-01-28T04:10:52.219 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).handle_message 2021-01-28T04:10:52.219 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 5 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).handle_message got 194 + 0 + 0 byte message. envelope type=18 src mon.2 off 0 2021-01-28T04:10:52.219 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 5 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=READ_MESSAGE_COMPLETE pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).handle_message received message m=0x5616ef9b44e0 seq=4 from=mon.2 type=18 auth_reply(proto 2 0 (0) Success) v1 2021-01-28T04:10:52.220 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 -- 172.21.15.134:0/3408237686 queue 0x5616ef9b44e0 prio 196 2021-01-28T04:10:52.220 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 --2- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 0x5616ef99f400 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x5616ef9afe60 tx=0x5616ef9e4d80).read_frame 2021-01-28T04:10:52.220 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d10b78700 20 -- 172.21.15.134:0/3408237686 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5616efa32c00 msgr2=0x5616ef99f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read start len=96 2021-01-28T04:10:52.220 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d0fb76700 1 -- 172.21.15.134:0/3408237686 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5616ef9b44e0 con 0x5616efa32c00 2021-01-28T04:10:52.221 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d0fb76700 10 -- 172.21.15.134:0/3408237686 dispatch_throttle_release 194 to dispatch throttler 194/104857600 2021-01-28T04:10:52.221 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.083+0000 7f8d0fb76700 20 -- 172.21.15.134:0/3408237686 done calling dispatch on 0x5616ef9b44e0 2021-01-28T04:10:52.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:51 smithi150 bash[9867]: cluster 2021-01-28T04:10:50.847065+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:52.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:51 smithi150 bash[13629]: cluster 2021-01-28T04:10:50.847065+0000 mgr.y (mgr.14138) 234 : cluster [DBG] pgmap v198: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:53.134 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:52 smithi134 bash[20192]: debug 2021-01-28T04:10:52.635+0000 7f8d17601200 -1 Falling back to public interface 2021-01-28T04:10:53.624 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:53 smithi134 bash[9858]: cluster 2021-01-28T04:10:52.847604+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:53.720 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:53 smithi150 bash[9867]: cluster 2021-01-28T04:10:52.847604+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:53.721 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:53 smithi150 bash[13629]: cluster 2021-01-28T04:10:52.847604+0000 mgr.y (mgr.14138) 235 : cluster [DBG] pgmap v199: 1 pgs: 1 active+clean; 0 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:54.332 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2021-01-28T04:10:54.333 INFO:teuthology.orchestra.run.smithi134.stdout: "id": "344b53ea-8457-407f-93b6-4ead80144ee4", 2021-01-28T04:10:54.333 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "realm", 2021-01-28T04:10:54.334 INFO:teuthology.orchestra.run.smithi134.stdout: "current_period": "83dbe69b-a164-4fd5-99f0-9262ab558859", 2021-01-28T04:10:54.334 INFO:teuthology.orchestra.run.smithi134.stdout: "epoch": 1 2021-01-28T04:10:54.335 INFO:teuthology.orchestra.run.smithi134.stdout:} 2021-01-28T04:10:54.609 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:54 smithi134 bash[9858]: cluster 2021-01-28T04:10:53.275428+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-28T04:10:54.610 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:54 smithi134 bash[9858]: audit 2021-01-28T04:10:53.276735+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:54.610 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:54 smithi134 bash[9858]: audit 2021-01-28T04:10:53.287287+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.134:0/1807501512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T04:10:54.611 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:54 smithi134 bash[9858]: audit 2021-01-28T04:10:53.287896+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T04:10:54.611 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:54 smithi134 bash[9858]: audit 2021-01-28T04:10:54.281962+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-28T04:10:54.611 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:54 smithi134 bash[9858]: cluster 2021-01-28T04:10:54.282098+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-28T04:10:54.612 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:54 smithi134 bash[9858]: audit 2021-01-28T04:10:54.282310+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:54.721 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[13629]: cluster 2021-01-28T04:10:53.275428+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-28T04:10:54.721 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[13629]: audit 2021-01-28T04:10:53.276735+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:54.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[13629]: audit 2021-01-28T04:10:53.287287+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.134:0/1807501512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T04:10:54.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[13629]: audit 2021-01-28T04:10:53.287896+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T04:10:54.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[13629]: audit 2021-01-28T04:10:54.281962+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-28T04:10:54.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[13629]: cluster 2021-01-28T04:10:54.282098+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-28T04:10:54.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[13629]: audit 2021-01-28T04:10:54.282310+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:54.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[9867]: cluster 2021-01-28T04:10:53.275428+0000 mon.a (mon.0) 493 : cluster [DBG] osdmap e44: 8 total, 7 up, 7 in 2021-01-28T04:10:54.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[9867]: audit 2021-01-28T04:10:53.276735+0000 mon.a (mon.0) 494 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:54.724 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[9867]: audit 2021-01-28T04:10:53.287287+0000 mon.b (mon.2) 15 : audit [INF] from='client.? 172.21.15.134:0/1807501512' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T04:10:54.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[9867]: audit 2021-01-28T04:10:53.287896+0000 mon.a (mon.0) 495 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2021-01-28T04:10:54.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[9867]: audit 2021-01-28T04:10:54.281962+0000 mon.a (mon.0) 496 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2021-01-28T04:10:54.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[9867]: cluster 2021-01-28T04:10:54.282098+0000 mon.a (mon.0) 497 : cluster [DBG] osdmap e45: 8 total, 7 up, 7 in 2021-01-28T04:10:54.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:54 smithi150 bash[9867]: audit 2021-01-28T04:10:54.282310+0000 mon.a (mon.0) 498 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:55.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- radosgw-admin zonegroup create --rgw-zonegroup=default --master --default 2021-01-28T04:10:55.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:55 smithi134 bash[9858]: audit 2021-01-28T04:10:54.656019+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:55.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:55 smithi134 bash[9858]: cluster 2021-01-28T04:10:54.848203+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v202: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 10 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:55.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:55 smithi134 bash[9858]: audit 2021-01-28T04:10:55.029729+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:55 smithi134 bash[9858]: audit 2021-01-28T04:10:55.037439+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:55 smithi134 bash[9858]: audit 2021-01-28T04:10:55.048482+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[9867]: audit 2021-01-28T04:10:54.656019+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:55.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[9867]: cluster 2021-01-28T04:10:54.848203+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v202: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 10 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:55.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[9867]: audit 2021-01-28T04:10:55.029729+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[9867]: audit 2021-01-28T04:10:55.037439+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[9867]: audit 2021-01-28T04:10:55.048482+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[13629]: audit 2021-01-28T04:10:54.656019+0000 mon.a (mon.0) 499 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:10:55.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[13629]: cluster 2021-01-28T04:10:54.848203+0000 mgr.y (mgr.14138) 236 : cluster [DBG] pgmap v202: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 10 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:55.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[13629]: audit 2021-01-28T04:10:55.029729+0000 mon.a (mon.0) 500 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[13629]: audit 2021-01-28T04:10:55.037439+0000 mon.a (mon.0) 501 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:55 smithi150 bash[13629]: audit 2021-01-28T04:10:55.048482+0000 mon.a (mon.0) 502 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:10:55.884 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:55 smithi134 bash[20192]: debug 2021-01-28T04:10:55.686+0000 7f8d17601200 -1 osd.7 0 log_to_monitors {default=true} 2021-01-28T04:10:56.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:56 smithi134 bash[9858]: cephadm 2021-01-28T04:10:55.039079+0000 mgr.y (mgr.14138) 237 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:56.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:56 smithi134 bash[9858]: cephadm 2021-01-28T04:10:55.049808+0000 mgr.y (mgr.14138) 238 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:56.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:56 smithi134 bash[9858]: cluster 2021-01-28T04:10:55.308439+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-28T04:10:56.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:56 smithi134 bash[9858]: audit 2021-01-28T04:10:55.309027+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:56.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:56 smithi134 bash[9858]: audit 2021-01-28T04:10:55.699112+0000 mon.b (mon.2) 16 : audit [INF] from='osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T04:10:56.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:56 smithi134 bash[9858]: audit 2021-01-28T04:10:55.700114+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T04:10:56.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[9867]: cephadm 2021-01-28T04:10:55.039079+0000 mgr.y (mgr.14138) 237 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:56.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[9867]: cephadm 2021-01-28T04:10:55.049808+0000 mgr.y (mgr.14138) 238 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:56.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[9867]: cluster 2021-01-28T04:10:55.308439+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-28T04:10:56.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[9867]: audit 2021-01-28T04:10:55.309027+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:56.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[9867]: audit 2021-01-28T04:10:55.699112+0000 mon.b (mon.2) 16 : audit [INF] from='osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T04:10:56.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[9867]: audit 2021-01-28T04:10:55.700114+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T04:10:56.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[13629]: cephadm 2021-01-28T04:10:55.039079+0000 mgr.y (mgr.14138) 237 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:56.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[13629]: cephadm 2021-01-28T04:10:55.049808+0000 mgr.y (mgr.14138) 238 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:10:56.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[13629]: cluster 2021-01-28T04:10:55.308439+0000 mon.a (mon.0) 503 : cluster [DBG] osdmap e46: 8 total, 7 up, 7 in 2021-01-28T04:10:56.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[13629]: audit 2021-01-28T04:10:55.309027+0000 mon.a (mon.0) 504 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:56.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[13629]: audit 2021-01-28T04:10:55.699112+0000 mon.b (mon.2) 16 : audit [INF] from='osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T04:10:56.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:56 smithi150 bash[13629]: audit 2021-01-28T04:10:55.700114+0000 mon.a (mon.0) 505 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2021-01-28T04:10:57.635 INFO:journalctl@ceph.osd.7.smithi134.stdout:Jan 28 04:10:57 smithi134 bash[20192]: debug 2021-01-28T04:10:57.338+0000 7f8d0f375700 -1 osd.7 0 waiting for initial osdmap 2021-01-28T04:10:57.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:57 smithi134 bash[9858]: audit 2021-01-28T04:10:56.319614+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-28T04:10:57.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:57 smithi134 bash[9858]: cluster 2021-01-28T04:10:56.319714+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-28T04:10:57.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:57 smithi134 bash[9858]: audit 2021-01-28T04:10:56.319880+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:57.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:57 smithi134 bash[9858]: audit 2021-01-28T04:10:56.323079+0000 mon.b (mon.2) 17 : audit [INF] from='osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:57.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:57 smithi134 bash[9858]: audit 2021-01-28T04:10:56.323805+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:57.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:57 smithi134 bash[9858]: cluster 2021-01-28T04:10:56.848794+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v205: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 10 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:57.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[9867]: audit 2021-01-28T04:10:56.319614+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-28T04:10:57.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[9867]: cluster 2021-01-28T04:10:56.319714+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-28T04:10:57.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[9867]: audit 2021-01-28T04:10:56.319880+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:57.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[9867]: audit 2021-01-28T04:10:56.323079+0000 mon.b (mon.2) 17 : audit [INF] from='osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:57.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[9867]: audit 2021-01-28T04:10:56.323805+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:57.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[9867]: cluster 2021-01-28T04:10:56.848794+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v205: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 10 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:57.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[13629]: audit 2021-01-28T04:10:56.319614+0000 mon.a (mon.0) 506 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2021-01-28T04:10:57.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[13629]: cluster 2021-01-28T04:10:56.319714+0000 mon.a (mon.0) 507 : cluster [DBG] osdmap e47: 8 total, 7 up, 7 in 2021-01-28T04:10:57.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[13629]: audit 2021-01-28T04:10:56.319880+0000 mon.a (mon.0) 508 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:57.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[13629]: audit 2021-01-28T04:10:56.323079+0000 mon.b (mon.2) 17 : audit [INF] from='osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:57.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[13629]: audit 2021-01-28T04:10:56.323805+0000 mon.a (mon.0) 509 : audit [INF] from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2021-01-28T04:10:57.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:57 smithi150 bash[13629]: cluster 2021-01-28T04:10:56.848794+0000 mgr.y (mgr.14138) 239 : cluster [DBG] pgmap v205: 33 pgs: 3 creating+peering, 4 active+clean, 26 unknown; 10 B data, 36 MiB used, 626 GiB / 626 GiB avail 2021-01-28T04:10:58.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:58 smithi134 bash[9858]: audit 2021-01-28T04:10:57.327944+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:10:58.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:58 smithi134 bash[9858]: cluster 2021-01-28T04:10:57.328134+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-01-28T04:10:58.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:58 smithi134 bash[9858]: audit 2021-01-28T04:10:57.333093+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:58.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:58 smithi134 bash[9858]: audit 2021-01-28T04:10:57.343618+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:58.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:58 smithi134 bash[9858]: cluster 2021-01-28T04:10:58.330056+0000 mon.a (mon.0) 514 : cluster [INF] osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315] boot 2021-01-28T04:10:58.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:58 smithi134 bash[9858]: cluster 2021-01-28T04:10:58.330236+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-28T04:10:58.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:58 smithi134 bash[9858]: audit 2021-01-28T04:10:58.330570+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:58.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[9867]: audit 2021-01-28T04:10:57.327944+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:10:58.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[9867]: cluster 2021-01-28T04:10:57.328134+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-01-28T04:10:58.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[9867]: audit 2021-01-28T04:10:57.333093+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:58.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[9867]: audit 2021-01-28T04:10:57.343618+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:58.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[9867]: cluster 2021-01-28T04:10:58.330056+0000 mon.a (mon.0) 514 : cluster [INF] osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315] boot 2021-01-28T04:10:58.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[9867]: cluster 2021-01-28T04:10:58.330236+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-28T04:10:58.723 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[9867]: audit 2021-01-28T04:10:58.330570+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:58.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[13629]: audit 2021-01-28T04:10:57.327944+0000 mon.a (mon.0) 510 : audit [INF] from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2021-01-28T04:10:58.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[13629]: cluster 2021-01-28T04:10:57.328134+0000 mon.a (mon.0) 511 : cluster [DBG] osdmap e48: 8 total, 7 up, 7 in 2021-01-28T04:10:58.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[13629]: audit 2021-01-28T04:10:57.333093+0000 mon.a (mon.0) 512 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:58.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[13629]: audit 2021-01-28T04:10:57.343618+0000 mon.a (mon.0) 513 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:58.724 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[13629]: cluster 2021-01-28T04:10:58.330056+0000 mon.a (mon.0) 514 : cluster [INF] osd.7 [v2:172.21.15.134:6824/1198397315,v1:172.21.15.134:6825/1198397315] boot 2021-01-28T04:10:58.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[13629]: cluster 2021-01-28T04:10:58.330236+0000 mon.a (mon.0) 515 : cluster [DBG] osdmap e49: 8 total, 8 up, 8 in 2021-01-28T04:10:58.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:58 smithi150 bash[13629]: audit 2021-01-28T04:10:58.330570+0000 mon.a (mon.0) 516 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2021-01-28T04:10:59.368 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2021-01-28T04:10:59.368 INFO:teuthology.orchestra.run.smithi134.stdout: "id": "05adb9fe-d0ce-400a-88e6-a4e770bedaf4", 2021-01-28T04:10:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "default", 2021-01-28T04:10:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "api_name": "default", 2021-01-28T04:10:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "is_master": "true", 2021-01-28T04:10:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "endpoints": [], 2021-01-28T04:10:59.369 INFO:teuthology.orchestra.run.smithi134.stdout: "hostnames": [], 2021-01-28T04:10:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "hostnames_s3website": [], 2021-01-28T04:10:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "master_zone": "", 2021-01-28T04:10:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "zones": [], 2021-01-28T04:10:59.370 INFO:teuthology.orchestra.run.smithi134.stdout: "placement_targets": [], 2021-01-28T04:10:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "default_placement": "", 2021-01-28T04:10:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "realm_id": "344b53ea-8457-407f-93b6-4ead80144ee4", 2021-01-28T04:10:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "sync_policy": { 2021-01-28T04:10:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: "groups": [] 2021-01-28T04:10:59.371 INFO:teuthology.orchestra.run.smithi134.stdout: } 2021-01-28T04:10:59.372 INFO:teuthology.orchestra.run.smithi134.stdout:} 2021-01-28T04:10:59.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:59 smithi134 bash[9858]: cluster 2021-01-28T04:10:56.707982+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:10:59.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:59 smithi134 bash[9858]: cluster 2021-01-28T04:10:56.708107+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:10:59.635 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:59 smithi134 bash[9858]: cluster 2021-01-28T04:10:58.849538+0000 mgr.y (mgr.14138) 240 : cluster [DBG] pgmap v208: 33 pgs: 13 peering, 20 active+clean; 478 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s 2021-01-28T04:10:59.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:10:59 smithi134 bash[9858]: cluster 2021-01-28T04:10:59.335036+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-28T04:10:59.721 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:59 smithi150 bash[9867]: cluster 2021-01-28T04:10:56.707982+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:10:59.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:59 smithi150 bash[9867]: cluster 2021-01-28T04:10:56.708107+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:10:59.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:59 smithi150 bash[9867]: cluster 2021-01-28T04:10:58.849538+0000 mgr.y (mgr.14138) 240 : cluster [DBG] pgmap v208: 33 pgs: 13 peering, 20 active+clean; 478 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s 2021-01-28T04:10:59.722 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:10:59 smithi150 bash[9867]: cluster 2021-01-28T04:10:59.335036+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-28T04:10:59.722 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:59 smithi150 bash[13629]: cluster 2021-01-28T04:10:56.707982+0000 osd.7 (osd.7) 1 : cluster [DBG] purged_snaps scrub starts 2021-01-28T04:10:59.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:59 smithi150 bash[13629]: cluster 2021-01-28T04:10:56.708107+0000 osd.7 (osd.7) 2 : cluster [DBG] purged_snaps scrub ok 2021-01-28T04:10:59.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:59 smithi150 bash[13629]: cluster 2021-01-28T04:10:58.849538+0000 mgr.y (mgr.14138) 240 : cluster [DBG] pgmap v208: 33 pgs: 13 peering, 20 active+clean; 478 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s 2021-01-28T04:10:59.723 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:10:59 smithi150 bash[13629]: cluster 2021-01-28T04:10:59.335036+0000 mon.a (mon.0) 517 : cluster [DBG] osdmap e50: 8 total, 8 up, 8 in 2021-01-28T04:11:00.254 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- radosgw-admin zone create --rgw-zonegroup=default --rgw-zone zone --master --default 2021-01-28T04:11:02.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:01 smithi134 bash[9858]: cluster 2021-01-28T04:11:00.850221+0000 mgr.y (mgr.14138) 241 : cluster [DBG] pgmap v210: 33 pgs: 13 peering, 20 active+clean; 524 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s; 2 B/s, 0 objects/s recovering 2021-01-28T04:11:02.221 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:01 smithi150 bash[9867]: cluster 2021-01-28T04:11:00.850221+0000 mgr.y (mgr.14138) 241 : cluster [DBG] pgmap v210: 33 pgs: 13 peering, 20 active+clean; 524 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s; 2 B/s, 0 objects/s recovering 2021-01-28T04:11:02.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:01 smithi150 bash[13629]: cluster 2021-01-28T04:11:00.850221+0000 mgr.y (mgr.14138) 241 : cluster [DBG] pgmap v210: 33 pgs: 13 peering, 20 active+clean; 524 B data, 42 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s wr, 2 op/s; 2 B/s, 0 objects/s recovering 2021-01-28T04:11:03.746 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2021-01-28T04:11:03.746 INFO:teuthology.orchestra.run.smithi134.stdout: "id": "ac17a5e9-3727-4dee-b391-c22de8b5131c", 2021-01-28T04:11:03.747 INFO:teuthology.orchestra.run.smithi134.stdout: "name": "zone", 2021-01-28T04:11:03.747 INFO:teuthology.orchestra.run.smithi134.stdout: "domain_root": "zone.rgw.meta:root", 2021-01-28T04:11:03.747 INFO:teuthology.orchestra.run.smithi134.stdout: "control_pool": "zone.rgw.control", 2021-01-28T04:11:03.747 INFO:teuthology.orchestra.run.smithi134.stdout: "gc_pool": "zone.rgw.log:gc", 2021-01-28T04:11:03.747 INFO:teuthology.orchestra.run.smithi134.stdout: "lc_pool": "zone.rgw.log:lc", 2021-01-28T04:11:03.748 INFO:teuthology.orchestra.run.smithi134.stdout: "log_pool": "zone.rgw.log", 2021-01-28T04:11:03.748 INFO:teuthology.orchestra.run.smithi134.stdout: "intent_log_pool": "zone.rgw.log:intent", 2021-01-28T04:11:03.748 INFO:teuthology.orchestra.run.smithi134.stdout: "usage_log_pool": "zone.rgw.log:usage", 2021-01-28T04:11:03.748 INFO:teuthology.orchestra.run.smithi134.stdout: "roles_pool": "zone.rgw.meta:roles", 2021-01-28T04:11:03.748 INFO:teuthology.orchestra.run.smithi134.stdout: "reshard_pool": "zone.rgw.log:reshard", 2021-01-28T04:11:03.749 INFO:teuthology.orchestra.run.smithi134.stdout: "user_keys_pool": "zone.rgw.meta:users.keys", 2021-01-28T04:11:03.749 INFO:teuthology.orchestra.run.smithi134.stdout: "user_email_pool": "zone.rgw.meta:users.email", 2021-01-28T04:11:03.749 INFO:teuthology.orchestra.run.smithi134.stdout: "user_swift_pool": "zone.rgw.meta:users.swift", 2021-01-28T04:11:03.749 INFO:teuthology.orchestra.run.smithi134.stdout: "user_uid_pool": "zone.rgw.meta:users.uid", 2021-01-28T04:11:03.750 INFO:teuthology.orchestra.run.smithi134.stdout: "otp_pool": "zone.rgw.otp", 2021-01-28T04:11:03.750 INFO:teuthology.orchestra.run.smithi134.stdout: "system_key": { 2021-01-28T04:11:03.750 INFO:teuthology.orchestra.run.smithi134.stdout: "access_key": "", 2021-01-28T04:11:03.750 INFO:teuthology.orchestra.run.smithi134.stdout: "secret_key": "" 2021-01-28T04:11:03.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2021-01-28T04:11:03.751 INFO:teuthology.orchestra.run.smithi134.stdout: "placement_pools": [ 2021-01-28T04:11:03.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2021-01-28T04:11:03.751 INFO:teuthology.orchestra.run.smithi134.stdout: "key": "default-placement", 2021-01-28T04:11:03.752 INFO:teuthology.orchestra.run.smithi134.stdout: "val": { 2021-01-28T04:11:03.752 INFO:teuthology.orchestra.run.smithi134.stdout: "index_pool": "zone.rgw.buckets.index", 2021-01-28T04:11:03.752 INFO:teuthology.orchestra.run.smithi134.stdout: "storage_classes": { 2021-01-28T04:11:03.752 INFO:teuthology.orchestra.run.smithi134.stdout: "STANDARD": { 2021-01-28T04:11:03.752 INFO:teuthology.orchestra.run.smithi134.stdout: "data_pool": "zone.rgw.buckets.data" 2021-01-28T04:11:03.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2021-01-28T04:11:03.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2021-01-28T04:11:03.753 INFO:teuthology.orchestra.run.smithi134.stdout: "data_extra_pool": "zone.rgw.buckets.non-ec", 2021-01-28T04:11:03.753 INFO:teuthology.orchestra.run.smithi134.stdout: "index_type": 0 2021-01-28T04:11:03.753 INFO:teuthology.orchestra.run.smithi134.stdout: } 2021-01-28T04:11:03.754 INFO:teuthology.orchestra.run.smithi134.stdout: } 2021-01-28T04:11:03.754 INFO:teuthology.orchestra.run.smithi134.stdout: ], 2021-01-28T04:11:03.754 INFO:teuthology.orchestra.run.smithi134.stdout: "realm_id": "344b53ea-8457-407f-93b6-4ead80144ee4", 2021-01-28T04:11:03.754 INFO:teuthology.orchestra.run.smithi134.stdout: "notif_pool": "zone.rgw.log:notif" 2021-01-28T04:11:03.755 INFO:teuthology.orchestra.run.smithi134.stdout:} 2021-01-28T04:11:04.135 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:03 smithi134 bash[9858]: cluster 2021-01-28T04:11:02.851048+0000 mgr.y (mgr.14138) 242 : cluster [DBG] pgmap v211: 33 pgs: 13 peering, 20 active+clean; 734 B data, 43 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 1.5 KiB/s wr, 2 op/s; 13 B/s, 0 objects/s recovering 2021-01-28T04:11:04.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:03 smithi150 bash[9867]: cluster 2021-01-28T04:11:02.851048+0000 mgr.y (mgr.14138) 242 : cluster [DBG] pgmap v211: 33 pgs: 13 peering, 20 active+clean; 734 B data, 43 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 1.5 KiB/s wr, 2 op/s; 13 B/s, 0 objects/s recovering 2021-01-28T04:11:04.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:03 smithi150 bash[13629]: cluster 2021-01-28T04:11:02.851048+0000 mgr.y (mgr.14138) 242 : cluster [DBG] pgmap v211: 33 pgs: 13 peering, 20 active+clean; 734 B data, 43 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 1.5 KiB/s wr, 2 op/s; 13 B/s, 0 objects/s recovering 2021-01-28T04:11:04.596 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch apply rgw realm zone --placement '1;smithi150=realm.zone.a' 2021-01-28T04:11:06.136 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:05 smithi134 bash[9858]: cluster 2021-01-28T04:11:04.851908+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v212: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 408 B/s rd, 816 B/s wr, 1 op/s; 22 B/s, 0 objects/s recovering 2021-01-28T04:11:06.222 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:05 smithi150 bash[9867]: cluster 2021-01-28T04:11:04.851908+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v212: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 408 B/s rd, 816 B/s wr, 1 op/s; 22 B/s, 0 objects/s recovering 2021-01-28T04:11:06.222 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:05 smithi150 bash[13629]: cluster 2021-01-28T04:11:04.851908+0000 mgr.y (mgr.14138) 243 : cluster [DBG] pgmap v212: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 408 B/s rd, 816 B/s wr, 1 op/s; 22 B/s, 0 objects/s recovering 2021-01-28T04:11:07.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:07 smithi134 bash[9858]: cluster 2021-01-28T04:11:06.852523+0000 mgr.y (mgr.14138) 244 : cluster [DBG] pgmap v213: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 360 B/s rd, 480 B/s wr, 0 op/s; 20 B/s, 0 objects/s recovering 2021-01-28T04:11:07.972 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:07 smithi150 bash[9867]: cluster 2021-01-28T04:11:06.852523+0000 mgr.y (mgr.14138) 244 : cluster [DBG] pgmap v213: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 360 B/s rd, 480 B/s wr, 0 op/s; 20 B/s, 0 objects/s recovering 2021-01-28T04:11:07.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:07 smithi150 bash[13629]: cluster 2021-01-28T04:11:06.852523+0000 mgr.y (mgr.14138) 244 : cluster [DBG] pgmap v213: 33 pgs: 33 active+clean; 780 B data, 43 MiB used, 715 GiB / 715 GiB avail; 360 B/s rd, 480 B/s wr, 0 op/s; 20 B/s, 0 objects/s recovering 2021-01-28T04:11:08.351 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled rgw.realm.zone update... 2021-01-28T04:11:09.211 DEBUG:teuthology.orchestra.run.smithi150:rgw.realm.zone.a> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@rgw.realm.zone.a.service 2021-01-28T04:11:09.215 INFO:tasks.cephadm:Adding ceph.iscsi.iscsi.a on smithi134 2021-01-28T04:11:09.216 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd pool create iscsi 3 3 replicated 2021-01-28T04:11:09.246 INFO:journalctl@ceph.rgw.realm.zone.a.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:11:09.485 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:08.345322+0000 mgr.y (mgr.14138) 245 : audit [DBG] from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi150=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:09.485 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: cephadm 2021-01-28T04:11:08.347204+0000 mgr.y (mgr.14138) 246 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi150=realm.zone.a;count:1 2021-01-28T04:11:09.485 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:08.353263+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.485 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: cephadm 2021-01-28T04:11:08.355829+0000 mgr.y (mgr.14138) 247 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:11:09.486 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:08.776011+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.486 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: cephadm 2021-01-28T04:11:08.778136+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:09.486 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: cephadm 2021-01-28T04:11:08.779364+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] 2021-01-28T04:11:09.486 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:08.780757+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T04:11:09.487 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:08.782455+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T04:11:09.487 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:08.790862+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-28T04:11:09.487 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: cluster 2021-01-28T04:11:08.854086+0000 mgr.y (mgr.14138) 250 : cluster [DBG] pgmap v214: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 921 B/s wr, 1 op/s; 17 B/s, 0 objects/s recovering 2021-01-28T04:11:09.487 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:09.060598+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.487 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:09.068216+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.488 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:09.075829+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.488 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:09.083196+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.488 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:09.084286+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T04:11:09.488 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:09.086011+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:11:09.489 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[9867]: audit 2021-01-28T04:11:09.088230+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-28T04:11:09.489 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:08.345322+0000 mgr.y (mgr.14138) 245 : audit [DBG] from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi150=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:09.490 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: cephadm 2021-01-28T04:11:08.347204+0000 mgr.y (mgr.14138) 246 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi150=realm.zone.a;count:1 2021-01-28T04:11:09.490 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:08.353263+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.490 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: cephadm 2021-01-28T04:11:08.355829+0000 mgr.y (mgr.14138) 247 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:11:09.491 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:08.776011+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.491 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: cephadm 2021-01-28T04:11:08.778136+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:09.491 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: cephadm 2021-01-28T04:11:08.779364+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] 2021-01-28T04:11:09.491 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:08.780757+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T04:11:09.492 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:08.782455+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T04:11:09.492 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:08.790862+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-28T04:11:09.492 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: cluster 2021-01-28T04:11:08.854086+0000 mgr.y (mgr.14138) 250 : cluster [DBG] pgmap v214: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 921 B/s wr, 1 op/s; 17 B/s, 0 objects/s recovering 2021-01-28T04:11:09.493 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:09.060598+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.493 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:09.068216+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.493 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:09.075829+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.494 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:09.083196+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.494 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:09.084286+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T04:11:09.494 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:09.086011+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:11:09.494 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:09 smithi150 bash[13629]: audit 2021-01-28T04:11:09.088230+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-28T04:11:09.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:08.345322+0000 mgr.y (mgr.14138) 245 : audit [DBG] from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "realm_name": "realm", "zone_name": "zone", "placement": "1;smithi150=realm.zone.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:09.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: cephadm 2021-01-28T04:11:08.347204+0000 mgr.y (mgr.14138) 246 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi150=realm.zone.a;count:1 2021-01-28T04:11:09.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:08.353263+0000 mon.a (mon.0) 518 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: cephadm 2021-01-28T04:11:08.355829+0000 mgr.y (mgr.14138) 247 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:11:09.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:08.776011+0000 mon.a (mon.0) 519 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: cephadm 2021-01-28T04:11:08.778136+0000 mgr.y (mgr.14138) 248 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:09.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: cephadm 2021-01-28T04:11:08.779364+0000 mgr.y (mgr.14138) 249 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] 2021-01-28T04:11:09.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:08.780757+0000 mon.a (mon.0) 520 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T04:11:09.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:08.782455+0000 mon.a (mon.0) 521 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T04:11:09.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:08.790862+0000 mon.a (mon.0) 522 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2021-01-28T04:11:09.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: cluster 2021-01-28T04:11:08.854086+0000 mgr.y (mgr.14138) 250 : cluster [DBG] pgmap v214: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 921 B/s wr, 1 op/s; 17 B/s, 0 objects/s recovering 2021-01-28T04:11:09.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:09.060598+0000 mon.a (mon.0) 523 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:09.068216+0000 mon.a (mon.0) 524 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:09.075829+0000 mon.a (mon.0) 525 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:09.083196+0000 mon.a (mon.0) 526 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:09.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:09.084286+0000 mon.a (mon.0) 527 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.realm.zone.a", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2021-01-28T04:11:09.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:09.086011+0000 mon.a (mon.0) 528 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:11:09.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:09 smithi134 bash[9858]: audit 2021-01-28T04:11:09.088230+0000 mon.a (mon.0) 529 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.rgw.realm.zone.a", "key": "container_image"}]: dispatch 2021-01-28T04:11:10.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:10 smithi134 bash[9858]: cephadm 2021-01-28T04:11:09.077290+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi150=realm.zone.a;count:1 2021-01-28T04:11:10.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:10 smithi134 bash[9858]: cephadm 2021-01-28T04:11:09.087147+0000 mgr.y (mgr.14138) 252 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi150 2021-01-28T04:11:11.110 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:10 smithi150 bash[9867]: cephadm 2021-01-28T04:11:09.077290+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi150=realm.zone.a;count:1 2021-01-28T04:11:11.111 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:10 smithi150 bash[9867]: cephadm 2021-01-28T04:11:09.087147+0000 mgr.y (mgr.14138) 252 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi150 2021-01-28T04:11:11.111 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:10 smithi150 bash[13629]: cephadm 2021-01-28T04:11:09.077290+0000 mgr.y (mgr.14138) 251 : cephadm [INF] Saving service rgw.realm.zone spec with placement smithi150=realm.zone.a;count:1 2021-01-28T04:11:11.111 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:10 smithi150 bash[13629]: cephadm 2021-01-28T04:11:09.087147+0000 mgr.y (mgr.14138) 252 : cephadm [INF] Deploying daemon rgw.realm.zone.a on smithi150 2021-01-28T04:11:11.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:11 smithi134 bash[9858]: cluster 2021-01-28T04:11:10.854944+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v215: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 444 B/s rd, 799 B/s wr, 1 op/s; 14 B/s, 0 objects/s recovering 2021-01-28T04:11:11.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:11 smithi134 bash[9858]: audit 2021-01-28T04:11:10.967232+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:12.084 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:11 smithi150 bash[13629]: cluster 2021-01-28T04:11:10.854944+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v215: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 444 B/s rd, 799 B/s wr, 1 op/s; 14 B/s, 0 objects/s recovering 2021-01-28T04:11:12.084 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:11 smithi150 bash[13629]: audit 2021-01-28T04:11:10.967232+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:12.084 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:11 smithi150 bash[9867]: cluster 2021-01-28T04:11:10.854944+0000 mgr.y (mgr.14138) 253 : cluster [DBG] pgmap v215: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 444 B/s rd, 799 B/s wr, 1 op/s; 14 B/s, 0 objects/s recovering 2021-01-28T04:11:12.085 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:11 smithi150 bash[9867]: audit 2021-01-28T04:11:10.967232+0000 mon.a (mon.0) 530 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:12.419 INFO:journalctl@ceph.rgw.realm.zone.a.smithi150.stdout:Jan 28 04:11:12 smithi150 systemd[1]: Started Ceph rgw.realm.zone.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:11:13.589 INFO:teuthology.orchestra.run.smithi134.stderr:pool 'iscsi' created 2021-01-28T04:11:13.814 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:13 smithi134 bash[9858]: audit 2021-01-28T04:11:12.366005+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:13.814 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:13 smithi134 bash[9858]: audit 2021-01-28T04:11:12.368396+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:13.815 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:13 smithi134 bash[9858]: cluster 2021-01-28T04:11:12.855670+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v216: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 682 B/s wr, 1 op/s; 13 B/s, 0 objects/s recovering 2021-01-28T04:11:13.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:13 smithi150 bash[9867]: audit 2021-01-28T04:11:12.366005+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:13.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:13 smithi150 bash[9867]: audit 2021-01-28T04:11:12.368396+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:13.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:13 smithi150 bash[9867]: cluster 2021-01-28T04:11:12.855670+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v216: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 682 B/s wr, 1 op/s; 13 B/s, 0 objects/s recovering 2021-01-28T04:11:13.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:13 smithi150 bash[13629]: audit 2021-01-28T04:11:12.366005+0000 mon.a (mon.0) 531 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:13.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:13 smithi150 bash[13629]: audit 2021-01-28T04:11:12.368396+0000 mon.a (mon.0) 532 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:13.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:13 smithi150 bash[13629]: cluster 2021-01-28T04:11:12.855670+0000 mgr.y (mgr.14138) 254 : cluster [DBG] pgmap v216: 33 pgs: 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 682 B/s wr, 1 op/s; 13 B/s, 0 objects/s recovering 2021-01-28T04:11:14.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd pool application enable iscsi rbd 2021-01-28T04:11:14.532 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:14 smithi134 bash[9858]: audit 2021-01-28T04:11:13.077499+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.134:0/2895824632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T04:11:14.533 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:14 smithi134 bash[9858]: audit 2021-01-28T04:11:13.078344+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T04:11:14.533 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:14 smithi134 bash[9858]: audit 2021-01-28T04:11:13.584529+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-28T04:11:14.533 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:14 smithi134 bash[9858]: cluster 2021-01-28T04:11:13.584654+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-28T04:11:14.533 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:14 smithi134 bash[9858]: audit 2021-01-28T04:11:14.197869+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:14.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:14 smithi134 bash[9858]: audit 2021-01-28T04:11:14.205003+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:14.534 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:14 smithi134 bash[9858]: audit 2021-01-28T04:11:14.214349+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:14.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[9867]: audit 2021-01-28T04:11:13.077499+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.134:0/2895824632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T04:11:14.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[9867]: audit 2021-01-28T04:11:13.078344+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T04:11:14.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[9867]: audit 2021-01-28T04:11:13.584529+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-28T04:11:14.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[9867]: cluster 2021-01-28T04:11:13.584654+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-28T04:11:14.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[9867]: audit 2021-01-28T04:11:14.197869+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:14.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[9867]: audit 2021-01-28T04:11:14.205003+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:14.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[9867]: audit 2021-01-28T04:11:14.214349+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:14.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[13629]: audit 2021-01-28T04:11:13.077499+0000 mon.b (mon.2) 18 : audit [INF] from='client.? 172.21.15.134:0/2895824632' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T04:11:14.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[13629]: audit 2021-01-28T04:11:13.078344+0000 mon.a (mon.0) 533 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]: dispatch 2021-01-28T04:11:14.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[13629]: audit 2021-01-28T04:11:13.584529+0000 mon.a (mon.0) 534 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "iscsi", "pg_num": 3, "pgp_num": 3, "pool_type": "replicated"}]': finished 2021-01-28T04:11:14.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[13629]: cluster 2021-01-28T04:11:13.584654+0000 mon.a (mon.0) 535 : cluster [DBG] osdmap e51: 8 total, 8 up, 8 in 2021-01-28T04:11:14.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[13629]: audit 2021-01-28T04:11:14.197869+0000 mon.a (mon.0) 536 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:14.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[13629]: audit 2021-01-28T04:11:14.205003+0000 mon.a (mon.0) 537 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:14.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:14 smithi150 bash[13629]: audit 2021-01-28T04:11:14.214349+0000 mon.a (mon.0) 538 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:15.884 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:15 smithi134 bash[9858]: cephadm 2021-01-28T04:11:14.206213+0000 mgr.y (mgr.14138) 255 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:15.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:15 smithi134 bash[9858]: cephadm 2021-01-28T04:11:14.206997+0000 mgr.y (mgr.14138) 256 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:15.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:15 smithi134 bash[9858]: cephadm 2021-01-28T04:11:14.215561+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:15.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:15 smithi134 bash[9858]: cephadm 2021-01-28T04:11:14.216508+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:15.885 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:15 smithi134 bash[9858]: cluster 2021-01-28T04:11:14.589905+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-28T04:11:15.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:15 smithi134 bash[9858]: audit 2021-01-28T04:11:14.600878+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.150:0/3355835767' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T04:11:15.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:15 smithi134 bash[9858]: audit 2021-01-28T04:11:14.601540+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T04:11:15.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:15 smithi134 bash[9858]: cluster 2021-01-28T04:11:14.856366+0000 mgr.y (mgr.14138) 259 : cluster [DBG] pgmap v219: 68 pgs: 10 creating+peering, 25 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 639 B/s wr, 1 op/s 2021-01-28T04:11:15.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[9867]: cephadm 2021-01-28T04:11:14.206213+0000 mgr.y (mgr.14138) 255 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:15.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[9867]: cephadm 2021-01-28T04:11:14.206997+0000 mgr.y (mgr.14138) 256 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:15.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[9867]: cephadm 2021-01-28T04:11:14.215561+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:15.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[9867]: cephadm 2021-01-28T04:11:14.216508+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:15.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[9867]: cluster 2021-01-28T04:11:14.589905+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-28T04:11:15.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[9867]: audit 2021-01-28T04:11:14.600878+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.150:0/3355835767' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T04:11:15.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[9867]: audit 2021-01-28T04:11:14.601540+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T04:11:15.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[9867]: cluster 2021-01-28T04:11:14.856366+0000 mgr.y (mgr.14138) 259 : cluster [DBG] pgmap v219: 68 pgs: 10 creating+peering, 25 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 639 B/s wr, 1 op/s 2021-01-28T04:11:15.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[13629]: cephadm 2021-01-28T04:11:14.206213+0000 mgr.y (mgr.14138) 255 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:15.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[13629]: cephadm 2021-01-28T04:11:14.206997+0000 mgr.y (mgr.14138) 256 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:15.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[13629]: cephadm 2021-01-28T04:11:14.215561+0000 mgr.y (mgr.14138) 257 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:15.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[13629]: cephadm 2021-01-28T04:11:14.216508+0000 mgr.y (mgr.14138) 258 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:15.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[13629]: cluster 2021-01-28T04:11:14.589905+0000 mon.a (mon.0) 539 : cluster [DBG] osdmap e52: 8 total, 8 up, 8 in 2021-01-28T04:11:15.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[13629]: audit 2021-01-28T04:11:14.600878+0000 mon.c (mon.1) 14 : audit [INF] from='client.? 172.21.15.150:0/3355835767' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T04:11:15.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[13629]: audit 2021-01-28T04:11:14.601540+0000 mon.a (mon.0) 540 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]: dispatch 2021-01-28T04:11:15.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:15 smithi150 bash[13629]: cluster 2021-01-28T04:11:14.856366+0000 mgr.y (mgr.14138) 259 : cluster [DBG] pgmap v219: 68 pgs: 10 creating+peering, 25 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 639 B/s wr, 1 op/s 2021-01-28T04:11:16.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:16 smithi134 bash[9858]: audit 2021-01-28T04:11:15.599747+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-28T04:11:16.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:16 smithi134 bash[9858]: cluster 2021-01-28T04:11:15.600077+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-28T04:11:16.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:16 smithi150 bash[9867]: audit 2021-01-28T04:11:15.599747+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-28T04:11:16.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:16 smithi150 bash[9867]: cluster 2021-01-28T04:11:15.600077+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-28T04:11:16.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:16 smithi150 bash[13629]: audit 2021-01-28T04:11:15.599747+0000 mon.a (mon.0) 541 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.log","app": "rgw"}]': finished 2021-01-28T04:11:16.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:16 smithi150 bash[13629]: cluster 2021-01-28T04:11:15.600077+0000 mon.a (mon.0) 542 : cluster [DBG] osdmap e53: 8 total, 8 up, 8 in 2021-01-28T04:11:17.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:17 smithi134 bash[9858]: cluster 2021-01-28T04:11:16.602258+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-28T04:11:17.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:17 smithi134 bash[9858]: audit 2021-01-28T04:11:16.609993+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.150:0/3355835767' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T04:11:17.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:17 smithi134 bash[9858]: audit 2021-01-28T04:11:16.617145+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T04:11:17.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:17 smithi134 bash[9858]: cluster 2021-01-28T04:11:16.857070+0000 mgr.y (mgr.14138) 260 : cluster [DBG] pgmap v222: 100 pgs: 10 creating+peering, 57 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:11:17.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:17 smithi134 bash[9858]: audit 2021-01-28T04:11:17.607977+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-28T04:11:17.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:17 smithi134 bash[9858]: cluster 2021-01-28T04:11:17.608921+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-28T04:11:17.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[9867]: cluster 2021-01-28T04:11:16.602258+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-28T04:11:17.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[9867]: audit 2021-01-28T04:11:16.609993+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.150:0/3355835767' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T04:11:17.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[9867]: audit 2021-01-28T04:11:16.617145+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T04:11:17.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[9867]: cluster 2021-01-28T04:11:16.857070+0000 mgr.y (mgr.14138) 260 : cluster [DBG] pgmap v222: 100 pgs: 10 creating+peering, 57 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:11:17.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[9867]: audit 2021-01-28T04:11:17.607977+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-28T04:11:17.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[9867]: cluster 2021-01-28T04:11:17.608921+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-28T04:11:17.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[13629]: cluster 2021-01-28T04:11:16.602258+0000 mon.a (mon.0) 543 : cluster [DBG] osdmap e54: 8 total, 8 up, 8 in 2021-01-28T04:11:17.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[13629]: audit 2021-01-28T04:11:16.609993+0000 mon.c (mon.1) 15 : audit [INF] from='client.? 172.21.15.150:0/3355835767' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T04:11:17.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[13629]: audit 2021-01-28T04:11:16.617145+0000 mon.a (mon.0) 544 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]: dispatch 2021-01-28T04:11:17.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[13629]: cluster 2021-01-28T04:11:16.857070+0000 mgr.y (mgr.14138) 260 : cluster [DBG] pgmap v222: 100 pgs: 10 creating+peering, 57 unknown, 33 active+clean; 1.9 KiB data, 43 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:11:17.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[13629]: audit 2021-01-28T04:11:17.607977+0000 mon.a (mon.0) 545 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.control","app": "rgw"}]': finished 2021-01-28T04:11:17.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:17 smithi150 bash[13629]: cluster 2021-01-28T04:11:17.608921+0000 mon.a (mon.0) 546 : cluster [DBG] osdmap e55: 8 total, 8 up, 8 in 2021-01-28T04:11:18.630 INFO:teuthology.orchestra.run.smithi134.stderr:enabled application 'rbd' on pool 'iscsi' 2021-01-28T04:11:18.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:18 smithi134 bash[9858]: audit 2021-01-28T04:11:18.055649+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.134:0/1397038782' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T04:11:18.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:18 smithi134 bash[9858]: audit 2021-01-28T04:11:18.056524+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T04:11:18.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:18 smithi150 bash[13629]: audit 2021-01-28T04:11:18.055649+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.134:0/1397038782' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T04:11:18.973 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:18 smithi150 bash[13629]: audit 2021-01-28T04:11:18.056524+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T04:11:18.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:18 smithi150 bash[9867]: audit 2021-01-28T04:11:18.055649+0000 mon.b (mon.2) 19 : audit [INF] from='client.? 172.21.15.134:0/1397038782' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T04:11:18.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:18 smithi150 bash[9867]: audit 2021-01-28T04:11:18.056524+0000 mon.a (mon.0) 547 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]: dispatch 2021-01-28T04:11:19.559 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch apply iscsi iscsi user password --placement '1;smithi134=iscsi.a' 2021-01-28T04:11:19.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:19 smithi134 bash[9858]: audit 2021-01-28T04:11:18.626485+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-28T04:11:19.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:19 smithi134 bash[9858]: cluster 2021-01-28T04:11:18.626748+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-28T04:11:19.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:19 smithi134 bash[9858]: cluster 2021-01-28T04:11:18.857937+0000 mgr.y (mgr.14138) 261 : cluster [DBG] pgmap v225: 100 pgs: 18 creating+peering, 4 unknown, 78 active+clean; 6.8 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 35 op/s 2021-01-28T04:11:19.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:19 smithi150 bash[9867]: audit 2021-01-28T04:11:18.626485+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-28T04:11:19.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:19 smithi150 bash[9867]: cluster 2021-01-28T04:11:18.626748+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-28T04:11:19.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:19 smithi150 bash[9867]: cluster 2021-01-28T04:11:18.857937+0000 mgr.y (mgr.14138) 261 : cluster [DBG] pgmap v225: 100 pgs: 18 creating+peering, 4 unknown, 78 active+clean; 6.8 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 35 op/s 2021-01-28T04:11:19.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:19 smithi150 bash[13629]: audit 2021-01-28T04:11:18.626485+0000 mon.a (mon.0) 548 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable", "pool": "iscsi", "app": "rbd"}]': finished 2021-01-28T04:11:19.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:19 smithi150 bash[13629]: cluster 2021-01-28T04:11:18.626748+0000 mon.a (mon.0) 549 : cluster [DBG] osdmap e56: 8 total, 8 up, 8 in 2021-01-28T04:11:19.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:19 smithi150 bash[13629]: cluster 2021-01-28T04:11:18.857937+0000 mgr.y (mgr.14138) 261 : cluster [DBG] pgmap v225: 100 pgs: 18 creating+peering, 4 unknown, 78 active+clean; 6.8 KiB data, 44 MiB used, 715 GiB / 715 GiB avail; 11 KiB/s rd, 8.0 KiB/s wr, 35 op/s 2021-01-28T04:11:20.967 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:20 smithi134 bash[9858]: cluster 2021-01-28T04:11:19.651194+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-28T04:11:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:20 smithi134 bash[9858]: audit 2021-01-28T04:11:19.656987+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T04:11:20.968 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:20 smithi134 bash[9858]: audit 2021-01-28T04:11:19.661916+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T04:11:20.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:20 smithi150 bash[9867]: cluster 2021-01-28T04:11:19.651194+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-28T04:11:20.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:20 smithi150 bash[9867]: audit 2021-01-28T04:11:19.656987+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T04:11:20.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:20 smithi150 bash[9867]: audit 2021-01-28T04:11:19.661916+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T04:11:20.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:20 smithi150 bash[13629]: cluster 2021-01-28T04:11:19.651194+0000 mon.a (mon.0) 550 : cluster [DBG] osdmap e57: 8 total, 8 up, 8 in 2021-01-28T04:11:20.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:20 smithi150 bash[13629]: audit 2021-01-28T04:11:19.656987+0000 mon.c (mon.1) 16 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T04:11:20.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:20 smithi150 bash[13629]: audit 2021-01-28T04:11:19.661916+0000 mon.a (mon.0) 551 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]: dispatch 2021-01-28T04:11:21.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[9867]: audit 2021-01-28T04:11:20.653973+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-28T04:11:21.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[9867]: cluster 2021-01-28T04:11:20.654257+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-28T04:11:21.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[9867]: audit 2021-01-28T04:11:20.658481+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T04:11:21.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[9867]: audit 2021-01-28T04:11:20.667538+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T04:11:21.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[9867]: cluster 2021-01-28T04:11:20.858736+0000 mgr.y (mgr.14138) 262 : cluster [DBG] pgmap v228: 132 pgs: 14 creating+peering, 27 unknown, 91 active+clean; 12 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 17 KiB/s wr, 70 op/s 2021-01-28T04:11:21.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[9867]: audit 2021-01-28T04:11:20.957815+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:11:21.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[9867]: audit 2021-01-28T04:11:20.960945+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:11:21.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[13629]: audit 2021-01-28T04:11:20.653973+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-28T04:11:21.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[13629]: cluster 2021-01-28T04:11:20.654257+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-28T04:11:21.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[13629]: audit 2021-01-28T04:11:20.658481+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T04:11:21.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[13629]: audit 2021-01-28T04:11:20.667538+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T04:11:21.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[13629]: cluster 2021-01-28T04:11:20.858736+0000 mgr.y (mgr.14138) 262 : cluster [DBG] pgmap v228: 132 pgs: 14 creating+peering, 27 unknown, 91 active+clean; 12 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 17 KiB/s wr, 70 op/s 2021-01-28T04:11:21.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[13629]: audit 2021-01-28T04:11:20.957815+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:11:21.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:21 smithi150 bash[13629]: audit 2021-01-28T04:11:20.960945+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:11:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:21 smithi134 bash[9858]: audit 2021-01-28T04:11:20.653973+0000 mon.a (mon.0) 552 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool application enable","pool": "zone.rgw.meta","app": "rgw"}]': finished 2021-01-28T04:11:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:21 smithi134 bash[9858]: cluster 2021-01-28T04:11:20.654257+0000 mon.a (mon.0) 553 : cluster [DBG] osdmap e58: 8 total, 8 up, 8 in 2021-01-28T04:11:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:21 smithi134 bash[9858]: audit 2021-01-28T04:11:20.658481+0000 mon.c (mon.1) 17 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T04:11:22.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:21 smithi134 bash[9858]: audit 2021-01-28T04:11:20.667538+0000 mon.a (mon.0) 554 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2021-01-28T04:11:22.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:21 smithi134 bash[9858]: cluster 2021-01-28T04:11:20.858736+0000 mgr.y (mgr.14138) 262 : cluster [DBG] pgmap v228: 132 pgs: 14 creating+peering, 27 unknown, 91 active+clean; 12 KiB data, 45 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 17 KiB/s wr, 70 op/s 2021-01-28T04:11:22.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:21 smithi134 bash[9858]: audit 2021-01-28T04:11:20.957815+0000 mon.a (mon.0) 555 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:11:22.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:21 smithi134 bash[9858]: audit 2021-01-28T04:11:20.960945+0000 mon.a (mon.0) 556 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:11:22.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[9867]: audit 2021-01-28T04:11:21.675684+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-28T04:11:22.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[9867]: cluster 2021-01-28T04:11:21.675999+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-28T04:11:22.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[9867]: audit 2021-01-28T04:11:21.678989+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T04:11:22.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[9867]: audit 2021-01-28T04:11:21.679422+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T04:11:22.974 INFO:journalctl@ceph.rgw.realm.zone.a.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[25194]: debug 2021-01-28T04:11:22.880+0000 7f52905e02c0 -1 rgw period pusher: The new period does not contain my zonegroup! 2021-01-28T04:11:22.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[13629]: audit 2021-01-28T04:11:21.675684+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-28T04:11:22.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[13629]: cluster 2021-01-28T04:11:21.675999+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-28T04:11:22.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[13629]: audit 2021-01-28T04:11:21.678989+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T04:11:22.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:22 smithi150 bash[13629]: audit 2021-01-28T04:11:21.679422+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T04:11:22.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:22 smithi134 bash[9858]: audit 2021-01-28T04:11:21.675684+0000 mon.a (mon.0) 557 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2021-01-28T04:11:22.976 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:22 smithi134 bash[9858]: cluster 2021-01-28T04:11:21.675999+0000 mon.a (mon.0) 558 : cluster [DBG] osdmap e59: 8 total, 8 up, 8 in 2021-01-28T04:11:22.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:22 smithi134 bash[9858]: audit 2021-01-28T04:11:21.678989+0000 mon.c (mon.1) 18 : audit [INF] from='client.? 172.21.15.150:0/226718652' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T04:11:22.977 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:22 smithi134 bash[9858]: audit 2021-01-28T04:11:21.679422+0000 mon.a (mon.0) 559 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd=[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2021-01-28T04:11:23.364 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled iscsi.iscsi update... 2021-01-28T04:11:23.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: audit 2021-01-28T04:11:22.686281+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-28T04:11:23.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: cluster 2021-01-28T04:11:22.686541+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-28T04:11:23.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: cluster 2021-01-28T04:11:22.859959+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v231: 132 pgs: 5 creating+peering, 22 unknown, 105 active+clean; 15 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 KiB/s wr, 54 op/s 2021-01-28T04:11:23.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: audit 2021-01-28T04:11:23.365093+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: audit 2021-01-28T04:11:23.373403+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: audit 2021-01-28T04:11:23.389669+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: audit 2021-01-28T04:11:23.391139+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-28T04:11:23.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: audit 2021-01-28T04:11:23.395699+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-28T04:11:23.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: audit 2021-01-28T04:11:23.407566+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:11:23.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:23 smithi134 bash[9858]: audit 2021-01-28T04:11:23.409564+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-28T04:11:23.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: audit 2021-01-28T04:11:22.686281+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-28T04:11:23.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: cluster 2021-01-28T04:11:22.686541+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-28T04:11:23.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: cluster 2021-01-28T04:11:22.859959+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v231: 132 pgs: 5 creating+peering, 22 unknown, 105 active+clean; 15 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 KiB/s wr, 54 op/s 2021-01-28T04:11:23.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: audit 2021-01-28T04:11:23.365093+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: audit 2021-01-28T04:11:23.373403+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: audit 2021-01-28T04:11:23.389669+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: audit 2021-01-28T04:11:23.391139+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-28T04:11:23.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: audit 2021-01-28T04:11:23.395699+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-28T04:11:23.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: audit 2021-01-28T04:11:23.407566+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:11:23.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[9867]: audit 2021-01-28T04:11:23.409564+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-28T04:11:23.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: audit 2021-01-28T04:11:22.686281+0000 mon.a (mon.0) 560 : audit [INF] from='client.? ' entity='client.rgw.realm.zone.a' cmd='[{"prefix": "osd pool set", "pool": "zone.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2021-01-28T04:11:23.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: cluster 2021-01-28T04:11:22.686541+0000 mon.a (mon.0) 561 : cluster [DBG] osdmap e60: 8 total, 8 up, 8 in 2021-01-28T04:11:23.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: cluster 2021-01-28T04:11:22.859959+0000 mgr.y (mgr.14138) 263 : cluster [DBG] pgmap v231: 132 pgs: 5 creating+peering, 22 unknown, 105 active+clean; 15 KiB data, 46 MiB used, 715 GiB / 715 GiB avail; 14 KiB/s rd, 14 KiB/s wr, 54 op/s 2021-01-28T04:11:23.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: audit 2021-01-28T04:11:23.365093+0000 mon.a (mon.0) 562 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: audit 2021-01-28T04:11:23.373403+0000 mon.a (mon.0) 563 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: audit 2021-01-28T04:11:23.389669+0000 mon.a (mon.0) 564 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:23.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: audit 2021-01-28T04:11:23.391139+0000 mon.a (mon.0) 565 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]: dispatch 2021-01-28T04:11:23.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: audit 2021-01-28T04:11:23.395699+0000 mon.a (mon.0) 566 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.iscsi.a", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "osd", "allow rwx"]}]': finished 2021-01-28T04:11:23.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: audit 2021-01-28T04:11:23.407566+0000 mon.a (mon.0) 567 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2021-01-28T04:11:23.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:23 smithi150 bash[13629]: audit 2021-01-28T04:11:23.409564+0000 mon.a (mon.0) 568 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "client.iscsi.iscsi.a", "key": "container_image"}]: dispatch 2021-01-28T04:11:24.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[9867]: audit 2021-01-28T04:11:23.358298+0000 mgr.y (mgr.14138) 264 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi134=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:24.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[9867]: cephadm 2021-01-28T04:11:23.360295+0000 mgr.y (mgr.14138) 265 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi134=iscsi.a;count:1 2021-01-28T04:11:24.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[9867]: cephadm 2021-01-28T04:11:23.374431+0000 mgr.y (mgr.14138) 266 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:24.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[9867]: cephadm 2021-01-28T04:11:23.375080+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:24.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[9867]: cephadm 2021-01-28T04:11:23.375875+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] 2021-01-28T04:11:24.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[9867]: cephadm 2021-01-28T04:11:23.376220+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-28T04:11:24.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[9867]: cephadm 2021-01-28T04:11:23.384315+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi134=iscsi.a;count:1 2021-01-28T04:11:24.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[9867]: cephadm 2021-01-28T04:11:23.408668+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi134 2021-01-28T04:11:24.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[13629]: audit 2021-01-28T04:11:23.358298+0000 mgr.y (mgr.14138) 264 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi134=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:24.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[13629]: cephadm 2021-01-28T04:11:23.360295+0000 mgr.y (mgr.14138) 265 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi134=iscsi.a;count:1 2021-01-28T04:11:24.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[13629]: cephadm 2021-01-28T04:11:23.374431+0000 mgr.y (mgr.14138) 266 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:24.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[13629]: cephadm 2021-01-28T04:11:23.375080+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:24.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[13629]: cephadm 2021-01-28T04:11:23.375875+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] 2021-01-28T04:11:24.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[13629]: cephadm 2021-01-28T04:11:23.376220+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-28T04:11:24.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[13629]: cephadm 2021-01-28T04:11:23.384315+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi134=iscsi.a;count:1 2021-01-28T04:11:24.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:24 smithi150 bash[13629]: cephadm 2021-01-28T04:11:23.408668+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi134 2021-01-28T04:11:25.033 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:24 smithi134 bash[9858]: audit 2021-01-28T04:11:23.358298+0000 mgr.y (mgr.14138) 264 : audit [DBG] from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "iscsi", "api_user": "user", "api_password": "password", "placement": "1;smithi134=iscsi.a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:25.033 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:24 smithi134 bash[9858]: cephadm 2021-01-28T04:11:23.360295+0000 mgr.y (mgr.14138) 265 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi134=iscsi.a;count:1 2021-01-28T04:11:25.034 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:24 smithi134 bash[9858]: cephadm 2021-01-28T04:11:23.374431+0000 mgr.y (mgr.14138) 266 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:25.034 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:24 smithi134 bash[9858]: cephadm 2021-01-28T04:11:23.375080+0000 mgr.y (mgr.14138) 267 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:25.034 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:24 smithi134 bash[9858]: cephadm 2021-01-28T04:11:23.375875+0000 mgr.y (mgr.14138) 268 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] 2021-01-28T04:11:25.034 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:24 smithi134 bash[9858]: cephadm 2021-01-28T04:11:23.376220+0000 mgr.y (mgr.14138) 269 : cephadm [INF] Checking pool "iscsi" exists for service iscsi.iscsi 2021-01-28T04:11:25.034 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:24 smithi134 bash[9858]: cephadm 2021-01-28T04:11:23.384315+0000 mgr.y (mgr.14138) 270 : cephadm [INF] Saving service iscsi.iscsi spec with placement smithi134=iscsi.a;count:1 2021-01-28T04:11:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:24 smithi134 bash[9858]: cephadm 2021-01-28T04:11:23.408668+0000 mgr.y (mgr.14138) 271 : cephadm [INF] Deploying daemon iscsi.iscsi.a on smithi134 2021-01-28T04:11:25.035 DEBUG:teuthology.orchestra.run.smithi134:iscsi.iscsi.a> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@iscsi.iscsi.a.service 2021-01-28T04:11:25.037 INFO:tasks.cephadm:Adding prometheus.a on smithi134 2021-01-28T04:11:25.038 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch apply prometheus '1;smithi134=a' 2021-01-28T04:11:25.088 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:11:25.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:25 smithi150 bash[9867]: cluster 2021-01-28T04:11:24.861350+0000 mgr.y (mgr.14138) 272 : cluster [DBG] pgmap v232: 132 pgs: 132 active+clean; 24 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 23 KiB/s wr, 261 op/s 2021-01-28T04:11:25.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:25 smithi150 bash[13629]: cluster 2021-01-28T04:11:24.861350+0000 mgr.y (mgr.14138) 272 : cluster [DBG] pgmap v232: 132 pgs: 132 active+clean; 24 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 23 KiB/s wr, 261 op/s 2021-01-28T04:11:26.083 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:25 smithi134 bash[9858]: cluster 2021-01-28T04:11:24.861350+0000 mgr.y (mgr.14138) 272 : cluster [DBG] pgmap v232: 132 pgs: 132 active+clean; 24 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 108 KiB/s rd, 23 KiB/s wr, 261 op/s 2021-01-28T04:11:26.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:26 smithi150 bash[9867]: cluster 2021-01-28T04:11:25.715350+0000 mon.a (mon.0) 569 : cluster [DBG] mgrmap e15: y(active, since 6m), standbys: x 2021-01-28T04:11:26.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:26 smithi150 bash[13629]: cluster 2021-01-28T04:11:25.715350+0000 mon.a (mon.0) 569 : cluster [DBG] mgrmap e15: y(active, since 6m), standbys: x 2021-01-28T04:11:27.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:26 smithi134 bash[9858]: cluster 2021-01-28T04:11:25.715350+0000 mon.a (mon.0) 569 : cluster [DBG] mgrmap e15: y(active, since 6m), standbys: x 2021-01-28T04:11:27.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:27 smithi134 bash[9858]: cluster 2021-01-28T04:11:26.862136+0000 mgr.y (mgr.14138) 273 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 24 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s rd, 14 KiB/s wr, 197 op/s 2021-01-28T04:11:27.973 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:27 smithi150 bash[9867]: cluster 2021-01-28T04:11:26.862136+0000 mgr.y (mgr.14138) 273 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 24 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s rd, 14 KiB/s wr, 197 op/s 2021-01-28T04:11:27.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:27 smithi150 bash[13629]: cluster 2021-01-28T04:11:26.862136+0000 mgr.y (mgr.14138) 273 : cluster [DBG] pgmap v233: 132 pgs: 132 active+clean; 24 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 85 KiB/s rd, 14 KiB/s wr, 197 op/s 2021-01-28T04:11:28.248 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:28 smithi134 systemd[1]: Started Ceph iscsi.iscsi.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:11:29.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:29 smithi150 bash[9867]: audit 2021-01-28T04:11:28.193378+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:29.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:29 smithi150 bash[9867]: cephadm 2021-01-28T04:11:28.195334+0000 mgr.y (mgr.14138) 274 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:11:29.474 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:29 smithi150 bash[9867]: audit 2021-01-28T04:11:28.196412+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:29.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:29 smithi150 bash[9867]: cluster 2021-01-28T04:11:28.863678+0000 mgr.y (mgr.14138) 275 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 12 KiB/s wr, 239 op/s 2021-01-28T04:11:29.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:29 smithi150 bash[13629]: audit 2021-01-28T04:11:28.193378+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:29.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:29 smithi150 bash[13629]: cephadm 2021-01-28T04:11:28.195334+0000 mgr.y (mgr.14138) 274 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:11:29.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:29 smithi150 bash[13629]: audit 2021-01-28T04:11:28.196412+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:29.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:29 smithi150 bash[13629]: cluster 2021-01-28T04:11:28.863678+0000 mgr.y (mgr.14138) 275 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 12 KiB/s wr, 239 op/s 2021-01-28T04:11:29.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:29 smithi134 bash[9858]: audit 2021-01-28T04:11:28.193378+0000 mon.a (mon.0) 570 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:29.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:29 smithi134 bash[9858]: cephadm 2021-01-28T04:11:28.195334+0000 mgr.y (mgr.14138) 274 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:11:29.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:29 smithi134 bash[9858]: audit 2021-01-28T04:11:28.196412+0000 mon.a (mon.0) 571 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:29.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:29 smithi134 bash[9858]: cluster 2021-01-28T04:11:28.863678+0000 mgr.y (mgr.14138) 275 : cluster [DBG] pgmap v234: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 107 KiB/s rd, 12 KiB/s wr, 239 op/s 2021-01-28T04:11:30.767 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.497514+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.768 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.505502+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.768 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: cephadm 2021-01-28T04:11:29.507125+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:30.768 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: cephadm 2021-01-28T04:11:29.508261+0000 mgr.y (mgr.14138) 277 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:30.768 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: cephadm 2021-01-28T04:11:29.509370+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:30.769 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.515309+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T04:11:30.769 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.516409+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T04:11:30.769 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: cephadm 2021-01-28T04:11:29.519747+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.134:5000 to Dashboard 2021-01-28T04:11:30.769 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.520247+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T04:11:30.769 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.520972+0000 mgr.y (mgr.14138) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T04:11:30.770 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.527125+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.770 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.532023+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi134"}]: dispatch 2021-01-28T04:11:30.770 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.533260+0000 mgr.y (mgr.14138) 282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi134"}]: dispatch 2021-01-28T04:11:30.770 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.545745+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.770 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: audit 2021-01-28T04:11:29.553443+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: cephadm 2021-01-28T04:11:29.554574+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:30.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: cephadm 2021-01-28T04:11:29.555615+0000 mgr.y (mgr.14138) 284 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:30.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[9858]: cephadm 2021-01-28T04:11:29.556300+0000 mgr.y (mgr.14138) 285 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:30.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.497514+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.505502+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: cephadm 2021-01-28T04:11:29.507125+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:30.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: cephadm 2021-01-28T04:11:29.508261+0000 mgr.y (mgr.14138) 277 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:30.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: cephadm 2021-01-28T04:11:29.509370+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:30.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.515309+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T04:11:30.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.516409+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T04:11:30.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: cephadm 2021-01-28T04:11:29.519747+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.134:5000 to Dashboard 2021-01-28T04:11:30.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.520247+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T04:11:30.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.520972+0000 mgr.y (mgr.14138) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T04:11:30.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.527125+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.532023+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi134"}]: dispatch 2021-01-28T04:11:30.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.533260+0000 mgr.y (mgr.14138) 282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi134"}]: dispatch 2021-01-28T04:11:30.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.545745+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: audit 2021-01-28T04:11:29.553443+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: cephadm 2021-01-28T04:11:29.554574+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:30.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: cephadm 2021-01-28T04:11:29.555615+0000 mgr.y (mgr.14138) 284 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:30.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[9867]: cephadm 2021-01-28T04:11:29.556300+0000 mgr.y (mgr.14138) 285 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:30.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.497514+0000 mon.a (mon.0) 572 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.505502+0000 mon.a (mon.0) 573 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.979 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: cephadm 2021-01-28T04:11:29.507125+0000 mgr.y (mgr.14138) 276 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:30.979 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: cephadm 2021-01-28T04:11:29.508261+0000 mgr.y (mgr.14138) 277 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:30.979 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: cephadm 2021-01-28T04:11:29.509370+0000 mgr.y (mgr.14138) 278 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:30.979 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.515309+0000 mon.a (mon.0) 574 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T04:11:30.979 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.516409+0000 mgr.y (mgr.14138) 279 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2021-01-28T04:11:30.980 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: cephadm 2021-01-28T04:11:29.519747+0000 mgr.y (mgr.14138) 280 : cephadm [INF] Adding iSCSI gateway http://:@172.21.15.134:5000 to Dashboard 2021-01-28T04:11:30.980 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.520247+0000 mon.a (mon.0) 575 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T04:11:30.980 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.520972+0000 mgr.y (mgr.14138) 281 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2021-01-28T04:11:30.980 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.527125+0000 mon.a (mon.0) 576 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.980 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.532023+0000 mon.a (mon.0) 577 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi134"}]: dispatch 2021-01-28T04:11:30.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.533260+0000 mgr.y (mgr.14138) 282 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi134"}]: dispatch 2021-01-28T04:11:30.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.545745+0000 mon.a (mon.0) 578 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: audit 2021-01-28T04:11:29.553443+0000 mon.a (mon.0) 579 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:30.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: cephadm 2021-01-28T04:11:29.554574+0000 mgr.y (mgr.14138) 283 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:30.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: cephadm 2021-01-28T04:11:29.555615+0000 mgr.y (mgr.14138) 284 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:30.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:30 smithi150 bash[13629]: cephadm 2021-01-28T04:11:29.556300+0000 mgr.y (mgr.14138) 285 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:31.016 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:30 smithi134 bash[22116]: log file path now is '/var/log/tcmu-runner.log' 2021-01-28T04:11:31.447 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled prometheus update... 2021-01-28T04:11:31.637 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[22142]: debug Started the configuration object watcher 2021-01-28T04:11:31.637 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[22142]: debug Checking for config object changes every 1s 2021-01-28T04:11:31.637 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[22142]: debug Processing osd blocklist entries for this node 2021-01-28T04:11:31.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[9858]: cluster 2021-01-28T04:11:30.864550+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 10 KiB/s wr, 208 op/s 2021-01-28T04:11:31.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[9858]: audit 2021-01-28T04:11:30.977183+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:31.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[9858]: audit 2021-01-28T04:11:31.447721+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:31.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[9858]: audit 2021-01-28T04:11:31.458453+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:31.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:31 smithi150 bash[9867]: cluster 2021-01-28T04:11:30.864550+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 10 KiB/s wr, 208 op/s 2021-01-28T04:11:31.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:31 smithi150 bash[9867]: audit 2021-01-28T04:11:30.977183+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:31.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:31 smithi150 bash[9867]: audit 2021-01-28T04:11:31.447721+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:31.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:31 smithi150 bash[9867]: audit 2021-01-28T04:11:31.458453+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:31.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:31 smithi150 bash[13629]: cluster 2021-01-28T04:11:30.864550+0000 mgr.y (mgr.14138) 286 : cluster [DBG] pgmap v235: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 93 KiB/s rd, 10 KiB/s wr, 208 op/s 2021-01-28T04:11:31.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:31 smithi150 bash[13629]: audit 2021-01-28T04:11:30.977183+0000 mon.a (mon.0) 580 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:31.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:31 smithi150 bash[13629]: audit 2021-01-28T04:11:31.447721+0000 mon.a (mon.0) 581 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:31.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:31 smithi150 bash[13629]: audit 2021-01-28T04:11:31.458453+0000 mon.a (mon.0) 582 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:32.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[22142]: debug Reading the configuration object to update local LIO configuration 2021-01-28T04:11:32.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[22142]: debug Configuration does not have an entry for this host(smithi134.front.sepia.ceph.com) - nothing to define to LIO 2021-01-28T04:11:32.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:31 smithi134 bash[22142]: debug * Running on http://[::]:5000/ (Press CTRL+C to quit) 2021-01-28T04:11:32.621 DEBUG:teuthology.orchestra.run.smithi134:prometheus.a> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@prometheus.a.service 2021-01-28T04:11:32.624 INFO:tasks.cephadm:Adding node-exporter.a on smithi150 2021-01-28T04:11:32.624 INFO:tasks.cephadm:Adding node-exporter.b on smithi134 2021-01-28T04:11:32.624 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch apply node-exporter '2;smithi150=a;smithi134=b' 2021-01-28T04:11:32.646 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:11:32.839 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:32 smithi134 bash[9858]: audit 2021-01-28T04:11:31.438981+0000 mgr.y (mgr.14138) 287 : audit [DBG] from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi134=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:32.839 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:32 smithi134 bash[9858]: cephadm 2021-01-28T04:11:31.441250+0000 mgr.y (mgr.14138) 288 : cephadm [INF] Saving service prometheus spec with placement smithi134=a;count:1 2021-01-28T04:11:32.839 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:32 smithi134 bash[9858]: cephadm 2021-01-28T04:11:31.459852+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:32.839 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:32 smithi134 bash[9858]: cephadm 2021-01-28T04:11:31.460535+0000 mgr.y (mgr.14138) 290 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:32.840 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:32 smithi134 bash[9858]: cephadm 2021-01-28T04:11:31.461164+0000 mgr.y (mgr.14138) 291 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:32.840 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:32 smithi134 bash[9858]: cephadm 2021-01-28T04:11:31.461824+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='a')] 2021-01-28T04:11:32.840 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:32 smithi134 bash[9858]: cephadm 2021-01-28T04:11:31.470525+0000 mgr.y (mgr.14138) 293 : cephadm [INF] Deploying daemon prometheus.a on smithi134 2021-01-28T04:11:32.840 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:32 smithi134 bash[9858]: audit 2021-01-28T04:11:31.695950+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.134:0/195529724' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-28T04:11:32.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[9867]: audit 2021-01-28T04:11:31.438981+0000 mgr.y (mgr.14138) 287 : audit [DBG] from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi134=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:32.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[9867]: cephadm 2021-01-28T04:11:31.441250+0000 mgr.y (mgr.14138) 288 : cephadm [INF] Saving service prometheus spec with placement smithi134=a;count:1 2021-01-28T04:11:32.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[9867]: cephadm 2021-01-28T04:11:31.459852+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:32.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[9867]: cephadm 2021-01-28T04:11:31.460535+0000 mgr.y (mgr.14138) 290 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:32.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[9867]: cephadm 2021-01-28T04:11:31.461164+0000 mgr.y (mgr.14138) 291 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:32.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[9867]: cephadm 2021-01-28T04:11:31.461824+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='a')] 2021-01-28T04:11:32.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[9867]: cephadm 2021-01-28T04:11:31.470525+0000 mgr.y (mgr.14138) 293 : cephadm [INF] Deploying daemon prometheus.a on smithi134 2021-01-28T04:11:32.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[9867]: audit 2021-01-28T04:11:31.695950+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.134:0/195529724' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-28T04:11:32.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[13629]: audit 2021-01-28T04:11:31.438981+0000 mgr.y (mgr.14138) 287 : audit [DBG] from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi134=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:32.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[13629]: cephadm 2021-01-28T04:11:31.441250+0000 mgr.y (mgr.14138) 288 : cephadm [INF] Saving service prometheus spec with placement smithi134=a;count:1 2021-01-28T04:11:32.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[13629]: cephadm 2021-01-28T04:11:31.459852+0000 mgr.y (mgr.14138) 289 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:32.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[13629]: cephadm 2021-01-28T04:11:31.460535+0000 mgr.y (mgr.14138) 290 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:32.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[13629]: cephadm 2021-01-28T04:11:31.461164+0000 mgr.y (mgr.14138) 291 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:32.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[13629]: cephadm 2021-01-28T04:11:31.461824+0000 mgr.y (mgr.14138) 292 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='a')] 2021-01-28T04:11:32.980 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[13629]: cephadm 2021-01-28T04:11:31.470525+0000 mgr.y (mgr.14138) 293 : cephadm [INF] Deploying daemon prometheus.a on smithi134 2021-01-28T04:11:32.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:32 smithi150 bash[13629]: audit 2021-01-28T04:11:31.695950+0000 mon.b (mon.2) 20 : audit [DBG] from='client.? 172.21.15.134:0/195529724' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2021-01-28T04:11:33.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:33 smithi134 bash[9858]: cluster 2021-01-28T04:11:32.865614+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 7.3 KiB/s wr, 181 op/s 2021-01-28T04:11:33.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:33 smithi150 bash[9867]: cluster 2021-01-28T04:11:32.865614+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 7.3 KiB/s wr, 181 op/s 2021-01-28T04:11:33.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:33 smithi150 bash[13629]: cluster 2021-01-28T04:11:32.865614+0000 mgr.y (mgr.14138) 294 : cluster [DBG] pgmap v236: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 82 KiB/s rd, 7.3 KiB/s wr, 181 op/s 2021-01-28T04:11:36.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:35 smithi150 bash[9867]: cluster 2021-01-28T04:11:34.867129+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 6.2 KiB/s wr, 154 op/s 2021-01-28T04:11:36.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:35 smithi150 bash[13629]: cluster 2021-01-28T04:11:34.867129+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 6.2 KiB/s wr, 154 op/s 2021-01-28T04:11:36.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:35 smithi134 bash[9858]: cluster 2021-01-28T04:11:34.867129+0000 mgr.y (mgr.14138) 295 : cluster [DBG] pgmap v237: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 70 KiB/s rd, 6.2 KiB/s wr, 154 op/s 2021-01-28T04:11:37.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:37 smithi134 bash[9858]: cluster 2021-01-28T04:11:36.867923+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 852 B/s wr, 58 op/s 2021-01-28T04:11:37.974 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:37 smithi150 bash[9867]: cluster 2021-01-28T04:11:36.867923+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 852 B/s wr, 58 op/s 2021-01-28T04:11:37.974 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:37 smithi150 bash[13629]: cluster 2021-01-28T04:11:36.867923+0000 mgr.y (mgr.14138) 296 : cluster [DBG] pgmap v238: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 852 B/s wr, 58 op/s 2021-01-28T04:11:39.212 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled node-exporter update... 2021-01-28T04:11:40.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:39 smithi150 bash[9867]: cluster 2021-01-28T04:11:38.869445+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 852 B/s wr, 59 op/s 2021-01-28T04:11:40.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:39 smithi150 bash[9867]: audit 2021-01-28T04:11:39.211551+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:40.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:39 smithi150 bash[13629]: cluster 2021-01-28T04:11:38.869445+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 852 B/s wr, 59 op/s 2021-01-28T04:11:40.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:39 smithi150 bash[13629]: audit 2021-01-28T04:11:39.211551+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:40.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:39 smithi134 bash[9858]: cluster 2021-01-28T04:11:38.869445+0000 mgr.y (mgr.14138) 297 : cluster [DBG] pgmap v239: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 28 KiB/s rd, 852 B/s wr, 59 op/s 2021-01-28T04:11:40.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:39 smithi134 bash[9858]: audit 2021-01-28T04:11:39.211551+0000 mon.a (mon.0) 583 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:40.494 DEBUG:teuthology.orchestra.run.smithi150:node-exporter.a> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@node-exporter.a.service 2021-01-28T04:11:40.525 DEBUG:teuthology.orchestra.run.smithi134:node-exporter.b> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@node-exporter.b.service 2021-01-28T04:11:40.532 INFO:tasks.cephadm:Adding alertmanager.a on smithi150 2021-01-28T04:11:40.532 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch apply alertmanager '1;smithi150=a' 2021-01-28T04:11:40.544 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:11:40.582 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:11:41.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:40 smithi134 bash[9858]: audit 2021-01-28T04:11:39.201683+0000 mgr.y (mgr.14138) 298 : audit [DBG] from='client.34463 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi150=a;smithi134=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:41.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:40 smithi134 bash[9858]: cephadm 2021-01-28T04:11:39.203842+0000 mgr.y (mgr.14138) 299 : cephadm [INF] Saving service node-exporter spec with placement smithi150=a;smithi134=b;count:2 2021-01-28T04:11:41.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:40 smithi150 bash[9867]: audit 2021-01-28T04:11:39.201683+0000 mgr.y (mgr.14138) 298 : audit [DBG] from='client.34463 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi150=a;smithi134=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:41.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:40 smithi150 bash[9867]: cephadm 2021-01-28T04:11:39.203842+0000 mgr.y (mgr.14138) 299 : cephadm [INF] Saving service node-exporter spec with placement smithi150=a;smithi134=b;count:2 2021-01-28T04:11:41.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:40 smithi150 bash[13629]: audit 2021-01-28T04:11:39.201683+0000 mgr.y (mgr.14138) 298 : audit [DBG] from='client.34463 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi150=a;smithi134=b", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:41.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:40 smithi150 bash[13629]: cephadm 2021-01-28T04:11:39.203842+0000 mgr.y (mgr.14138) 299 : cephadm [INF] Saving service node-exporter spec with placement smithi150=a;smithi134=b;count:2 2021-01-28T04:11:41.637 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:41 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:11:41.724 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:11:41 smithi150 bash[10146]: debug 2021-01-28T04:11:41.366+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:11:42.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:41 smithi134 bash[9858]: cluster 2021-01-28T04:11:40.870383+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2021-01-28T04:11:42.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:41 smithi150 bash[9867]: cluster 2021-01-28T04:11:40.870383+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2021-01-28T04:11:42.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:41 smithi150 bash[13629]: cluster 2021-01-28T04:11:40.870383+0000 mgr.y (mgr.14138) 300 : cluster [DBG] pgmap v240: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 85 B/s wr, 1 op/s 2021-01-28T04:11:43.215 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:42 smithi134 bash[9858]: audit 2021-01-28T04:11:41.369024+0000 mgr.y (mgr.14138) 301 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:11:43.224 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:42 smithi150 bash[9867]: audit 2021-01-28T04:11:41.369024+0000 mgr.y (mgr.14138) 301 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:11:43.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:42 smithi150 bash[13629]: audit 2021-01-28T04:11:41.369024+0000 mgr.y (mgr.14138) 301 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:11:44.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:43 smithi150 bash[9867]: cluster 2021-01-28T04:11:42.871399+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-01-28T04:11:44.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:43 smithi150 bash[13629]: cluster 2021-01-28T04:11:42.871399+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-01-28T04:11:44.280 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:43 smithi134 bash[9858]: cluster 2021-01-28T04:11:42.871399+0000 mgr.y (mgr.14138) 302 : cluster [DBG] pgmap v241: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 85 B/s wr, 2 op/s 2021-01-28T04:11:46.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:45 smithi150 bash[13629]: cluster 2021-01-28T04:11:44.872810+0000 mgr.y (mgr.14138) 303 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-28T04:11:46.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:45 smithi150 bash[9867]: cluster 2021-01-28T04:11:44.872810+0000 mgr.y (mgr.14138) 303 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-28T04:11:46.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:45 smithi134 bash[9858]: cluster 2021-01-28T04:11:44.872810+0000 mgr.y (mgr.14138) 303 : cluster [DBG] pgmap v242: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 0 B/s wr, 1 op/s 2021-01-28T04:11:47.018 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled alertmanager update... 2021-01-28T04:11:47.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:47 smithi134 bash[9858]: cluster 2021-01-28T04:11:46.873505+0000 mgr.y (mgr.14138) 304 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:47.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:47 smithi134 bash[9858]: audit 2021-01-28T04:11:47.016627+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:47.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:47 smithi150 bash[9867]: cluster 2021-01-28T04:11:46.873505+0000 mgr.y (mgr.14138) 304 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:47.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:47 smithi150 bash[9867]: audit 2021-01-28T04:11:47.016627+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:47.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:47 smithi150 bash[13629]: cluster 2021-01-28T04:11:46.873505+0000 mgr.y (mgr.14138) 304 : cluster [DBG] pgmap v243: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:47.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:47 smithi150 bash[13629]: audit 2021-01-28T04:11:47.016627+0000 mon.a (mon.0) 584 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:48.509 DEBUG:teuthology.orchestra.run.smithi150:alertmanager.a> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@alertmanager.a.service 2021-01-28T04:11:48.516 INFO:tasks.cephadm:Adding grafana.a on smithi134 2021-01-28T04:11:48.517 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph orch apply grafana '1;smithi134=a' 2021-01-28T04:11:48.564 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:11:48.874 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:48 smithi134 bash[9858]: audit 2021-01-28T04:11:47.007766+0000 mgr.y (mgr.14138) 305 : audit [DBG] from='client.34469 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi150=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:48.875 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:48 smithi134 bash[9858]: cephadm 2021-01-28T04:11:47.009821+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Saving service alertmanager spec with placement smithi150=a;count:1 2021-01-28T04:11:48.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:48 smithi150 bash[9867]: audit 2021-01-28T04:11:47.007766+0000 mgr.y (mgr.14138) 305 : audit [DBG] from='client.34469 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi150=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:48.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:48 smithi150 bash[9867]: cephadm 2021-01-28T04:11:47.009821+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Saving service alertmanager spec with placement smithi150=a;count:1 2021-01-28T04:11:48.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:48 smithi150 bash[13629]: audit 2021-01-28T04:11:47.007766+0000 mgr.y (mgr.14138) 305 : audit [DBG] from='client.34469 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi150=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:48.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:48 smithi150 bash[13629]: cephadm 2021-01-28T04:11:47.009821+0000 mgr.y (mgr.14138) 306 : cephadm [INF] Saving service alertmanager spec with placement smithi150=a;count:1 2021-01-28T04:11:49.137 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:49 smithi134 systemd[1]: Started Ceph prometheus.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:11:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:49 smithi134 bash[9858]: cluster 2021-01-28T04:11:48.874945+0000 mgr.y (mgr.14138) 307 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:11:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:49 smithi134 bash[9858]: audit 2021-01-28T04:11:49.170343+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:49.913 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:49 smithi134 bash[9858]: audit 2021-01-28T04:11:49.173530+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:49.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:49 smithi150 bash[9867]: cluster 2021-01-28T04:11:48.874945+0000 mgr.y (mgr.14138) 307 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:11:49.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:49 smithi150 bash[9867]: audit 2021-01-28T04:11:49.170343+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:49.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:49 smithi150 bash[9867]: audit 2021-01-28T04:11:49.173530+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:49.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:49 smithi150 bash[13629]: cluster 2021-01-28T04:11:48.874945+0000 mgr.y (mgr.14138) 307 : cluster [DBG] pgmap v244: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:11:49.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:49 smithi150 bash[13629]: audit 2021-01-28T04:11:49.170343+0000 mon.a (mon.0) 585 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:49.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:49 smithi150 bash[13629]: audit 2021-01-28T04:11:49.173530+0000 mon.a (mon.0) 586 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:11:51.638 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:11:51.638 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.455Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-01-28T04:11:51.638 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.455Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-01-28T04:11:51.639 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.455Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-01-28T04:11:51.639 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.455Z caller=main.go:339 host_details="(Linux 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 smithi134 (none))" 2021-01-28T04:11:51.639 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.455Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-01-28T04:11:51.639 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.455Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-01-28T04:11:51.640 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.457Z caller=main.go:678 msg="Starting TSDB ..." 2021-01-28T04:11:51.640 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.457Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-01-28T04:11:51.640 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.460Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-01-28T04:11:51.640 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.461Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2021-01-28T04:11:51.641 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.461Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=317.098µs 2021-01-28T04:11:51.641 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.462Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-01-28T04:11:51.641 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.462Z caller=main.go:695 msg="TSDB started" 2021-01-28T04:11:51.642 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.462Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-28T04:11:51.642 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.463Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-28T04:11:51.643 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[23256]: level=info ts=2021-01-28T04:11:51.463Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-28T04:11:51.726 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:11:51 smithi150 bash[10146]: debug 2021-01-28T04:11:51.373+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:11:52.215 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:51 smithi134 bash[9858]: cluster 2021-01-28T04:11:50.875836+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:52.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:51 smithi150 bash[9867]: cluster 2021-01-28T04:11:50.875836+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:52.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:51 smithi150 bash[13629]: cluster 2021-01-28T04:11:50.875836+0000 mgr.y (mgr.14138) 308 : cluster [DBG] pgmap v245: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:53.033 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:52 smithi150 bash[9867]: audit 2021-01-28T04:11:51.375997+0000 mgr.y (mgr.14138) 309 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:11:53.033 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:52 smithi150 bash[9867]: audit 2021-01-28T04:11:52.119820+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:53.034 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:52 smithi150 bash[9867]: audit 2021-01-28T04:11:52.127650+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:53.034 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:52 smithi150 systemd[1]: Started Ceph node-exporter.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:11:53.034 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:52 smithi150 bash[13629]: audit 2021-01-28T04:11:51.375997+0000 mgr.y (mgr.14138) 309 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:11:53.034 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:52 smithi150 bash[13629]: audit 2021-01-28T04:11:52.119820+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:53.035 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:52 smithi150 bash[13629]: audit 2021-01-28T04:11:52.127650+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:53.193 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:52 smithi134 bash[9858]: audit 2021-01-28T04:11:51.375997+0000 mgr.y (mgr.14138) 309 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:11:53.193 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:52 smithi134 bash[9858]: audit 2021-01-28T04:11:52.119820+0000 mon.a (mon.0) 587 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:53.193 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:52 smithi134 bash[9858]: audit 2021-01-28T04:11:52.127650+0000 mon.a (mon.0) 588 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:53.300 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-28T04:11:53.634 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled grafana update... 2021-01-28T04:11:53.639 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: v0.18.1: Pulling from prom/node-exporter 2021-01-28T04:11:53.639 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 49a2d53aa1af: Pulling fs layer 2021-01-28T04:11:53.640 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 3589a6efd9ce: Pulling fs layer 2021-01-28T04:11:53.640 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 190160031744: Pulling fs layer 2021-01-28T04:11:53.640 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 3589a6efd9ce: Verifying Checksum 2021-01-28T04:11:53.640 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 3589a6efd9ce: Download complete 2021-01-28T04:11:53.641 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 49a2d53aa1af: Verifying Checksum 2021-01-28T04:11:53.641 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 49a2d53aa1af: Download complete 2021-01-28T04:11:53.641 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 190160031744: Verifying Checksum 2021-01-28T04:11:53.641 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 190160031744: Download complete 2021-01-28T04:11:53.641 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[26160]: 49a2d53aa1af: Pull complete 2021-01-28T04:11:54.101 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:53 smithi134 bash[9858]: cephadm 2021-01-28T04:11:52.129091+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:54.101 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:53 smithi134 bash[9858]: cephadm 2021-01-28T04:11:52.130090+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:54.102 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:53 smithi134 systemd[1]: Started Ceph node-exporter.b for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:11:54.226 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[26160]: 3589a6efd9ce: Pull complete 2021-01-28T04:11:54.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: cephadm 2021-01-28T04:11:52.129091+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:54.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: cephadm 2021-01-28T04:11:52.130090+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: cephadm 2021-01-28T04:11:52.130853+0000 mgr.y (mgr.14138) 312 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: cephadm 2021-01-28T04:11:52.131578+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:11:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: cephadm 2021-01-28T04:11:52.132381+0000 mgr.y (mgr.14138) 314 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='b'), HostPlacementSpec(hostname='smithi150', network='', name='a')] 2021-01-28T04:11:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: cephadm 2021-01-28T04:11:52.132873+0000 mgr.y (mgr.14138) 315 : cephadm [INF] Deploying daemon node-exporter.a on smithi150 2021-01-28T04:11:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: cluster 2021-01-28T04:11:52.876767+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:11:54.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: audit 2021-01-28T04:11:52.988467+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: audit 2021-01-28T04:11:53.631990+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[13629]: audit 2021-01-28T04:11:53.897029+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: cephadm 2021-01-28T04:11:52.129091+0000 mgr.y (mgr.14138) 310 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:11:54.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: cephadm 2021-01-28T04:11:52.130090+0000 mgr.y (mgr.14138) 311 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:11:54.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: cephadm 2021-01-28T04:11:52.130853+0000 mgr.y (mgr.14138) 312 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:54.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: cephadm 2021-01-28T04:11:52.131578+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:11:54.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: cephadm 2021-01-28T04:11:52.132381+0000 mgr.y (mgr.14138) 314 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='b'), HostPlacementSpec(hostname='smithi150', network='', name='a')] 2021-01-28T04:11:54.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: cephadm 2021-01-28T04:11:52.132873+0000 mgr.y (mgr.14138) 315 : cephadm [INF] Deploying daemon node-exporter.a on smithi150 2021-01-28T04:11:54.230 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: cluster 2021-01-28T04:11:52.876767+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:11:54.230 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: audit 2021-01-28T04:11:52.988467+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.230 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: audit 2021-01-28T04:11:53.631990+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.230 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:53 smithi150 bash[9867]: audit 2021-01-28T04:11:53.897029+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cephadm 2021-01-28T04:11:52.130853+0000 mgr.y (mgr.14138) 312 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:11:54.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cephadm 2021-01-28T04:11:52.131578+0000 mgr.y (mgr.14138) 313 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:11:54.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cephadm 2021-01-28T04:11:52.132381+0000 mgr.y (mgr.14138) 314 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='b'), HostPlacementSpec(hostname='smithi150', network='', name='a')] 2021-01-28T04:11:54.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cephadm 2021-01-28T04:11:52.132873+0000 mgr.y (mgr.14138) 315 : cephadm [INF] Deploying daemon node-exporter.a on smithi150 2021-01-28T04:11:54.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cluster 2021-01-28T04:11:52.876767+0000 mgr.y (mgr.14138) 316 : cluster [DBG] pgmap v246: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:11:54.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: audit 2021-01-28T04:11:52.988467+0000 mon.a (mon.0) 589 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: audit 2021-01-28T04:11:53.631990+0000 mon.a (mon.0) 590 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: audit 2021-01-28T04:11:53.897029+0000 mon.a (mon.0) 591 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:11:54.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: Unable to find image 'prom/node-exporter:v0.18.1' locally 2021-01-28T04:11:54.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: v0.18.1: Pulling from prom/node-exporter 2021-01-28T04:11:54.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 49a2d53aa1af: Pulling fs layer 2021-01-28T04:11:54.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 3589a6efd9ce: Pulling fs layer 2021-01-28T04:11:54.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 190160031744: Pulling fs layer 2021-01-28T04:11:54.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 3589a6efd9ce: Verifying Checksum 2021-01-28T04:11:54.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 3589a6efd9ce: Download complete 2021-01-28T04:11:54.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 49a2d53aa1af: Download complete 2021-01-28T04:11:54.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 190160031744: Verifying Checksum 2021-01-28T04:11:54.392 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 190160031744: Download complete 2021-01-28T04:11:54.607 DEBUG:teuthology.orchestra.run.smithi134:grafana.a> sudo journalctl -f -n 0 -u ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@grafana.a.service 2021-01-28T04:11:54.611 INFO:tasks.cephadm:Setting up client nodes... 2021-01-28T04:11:54.612 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-28T04:11:54.635 INFO:journalctl@ceph.grafana.a.smithi134.stdout:-- Logs begin at Sun 2021-01-24 12:21:16 UTC. -- 2021-01-28T04:11:54.726 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[26160]: 190160031744: Pull complete 2021-01-28T04:11:54.726 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[26160]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-28T04:11:54.726 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[26160]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-28T04:11:54.887 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 49a2d53aa1af: Pull complete 2021-01-28T04:11:55.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[13629]: cephadm 2021-01-28T04:11:52.989312+0000 mgr.y (mgr.14138) 317 : cephadm [INF] Deploying daemon node-exporter.b on smithi134 2021-01-28T04:11:55.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[13629]: audit 2021-01-28T04:11:53.623182+0000 mgr.y (mgr.14138) 318 : audit [DBG] from='client.34475 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi134=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:55.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[13629]: cephadm 2021-01-28T04:11:53.625218+0000 mgr.y (mgr.14138) 319 : cephadm [INF] Saving service grafana spec with placement smithi134=a;count:1 2021-01-28T04:11:55.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[13629]: cephadm 2021-01-28T04:11:53.898727+0000 mgr.y (mgr.14138) 320 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi150', network='', name='a')] 2021-01-28T04:11:55.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[13629]: cephadm 2021-01-28T04:11:53.906155+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Deploying daemon alertmanager.a on smithi150 2021-01-28T04:11:55.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[9867]: cephadm 2021-01-28T04:11:52.989312+0000 mgr.y (mgr.14138) 317 : cephadm [INF] Deploying daemon node-exporter.b on smithi134 2021-01-28T04:11:55.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[9867]: audit 2021-01-28T04:11:53.623182+0000 mgr.y (mgr.14138) 318 : audit [DBG] from='client.34475 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi134=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:55.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[9867]: cephadm 2021-01-28T04:11:53.625218+0000 mgr.y (mgr.14138) 319 : cephadm [INF] Saving service grafana spec with placement smithi134=a;count:1 2021-01-28T04:11:55.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[9867]: cephadm 2021-01-28T04:11:53.898727+0000 mgr.y (mgr.14138) 320 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi150', network='', name='a')] 2021-01-28T04:11:55.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:54 smithi150 bash[9867]: cephadm 2021-01-28T04:11:53.906155+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Deploying daemon alertmanager.a on smithi150 2021-01-28T04:11:55.343 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cephadm 2021-01-28T04:11:52.989312+0000 mgr.y (mgr.14138) 317 : cephadm [INF] Deploying daemon node-exporter.b on smithi134 2021-01-28T04:11:55.344 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: audit 2021-01-28T04:11:53.623182+0000 mgr.y (mgr.14138) 318 : audit [DBG] from='client.34475 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi134=a", "target": ["mon-mgr", ""]}]: dispatch 2021-01-28T04:11:55.344 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cephadm 2021-01-28T04:11:53.625218+0000 mgr.y (mgr.14138) 319 : cephadm [INF] Saving service grafana spec with placement smithi134=a;count:1 2021-01-28T04:11:55.344 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cephadm 2021-01-28T04:11:53.898727+0000 mgr.y (mgr.14138) 320 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi150', network='', name='a')] 2021-01-28T04:11:55.344 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[9858]: cephadm 2021-01-28T04:11:53.906155+0000 mgr.y (mgr.14138) 321 : cephadm [INF] Deploying daemon alertmanager.a on smithi150 2021-01-28T04:11:55.345 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:54 smithi134 bash[23800]: 3589a6efd9ce: Pull complete 2021-01-28T04:11:55.637 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:55 smithi134 bash[23800]: 190160031744: Pull complete 2021-01-28T04:11:55.638 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:55 smithi134 bash[23800]: Digest: sha256:a2f29256e53cc3e0b64d7a472512600b2e9410347d53cdc85b49f659c17e02ee 2021-01-28T04:11:55.638 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:55 smithi134 bash[23800]: Status: Downloaded newer image for prom/node-exporter:v0.18.1 2021-01-28T04:11:56.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:55 smithi150 bash[9867]: cluster 2021-01-28T04:11:54.878203+0000 mgr.y (mgr.14138) 322 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:56.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:55 smithi150 bash[13629]: cluster 2021-01-28T04:11:54.878203+0000 mgr.y (mgr.14138) 322 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:56.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:55 smithi134 bash[9858]: cluster 2021-01-28T04:11:54.878203+0000 mgr.y (mgr.14138) 322 : cluster [DBG] pgmap v247: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:57.388 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-28T04:11:57.389 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-28T04:11:57.389 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-28T04:11:57.389 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-28T04:11:57.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-28T04:11:57.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-28T04:11:57.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-28T04:11:57.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-28T04:11:57.390 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-28T04:11:57.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-28T04:11:57.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-28T04:11:57.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-28T04:11:57.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-28T04:11:57.391 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-28T04:11:57.392 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-28T04:11:57.392 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-28T04:11:57.392 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-28T04:11:57.392 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-28T04:11:57.392 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-28T04:11:57.393 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-28T04:11:57.393 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-28T04:11:57.393 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-28T04:11:57.393 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-28T04:11:57.394 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-28T04:11:57.394 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-28T04:11:57.394 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-28T04:11:57.394 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-28T04:11:57.395 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-28T04:11:57.395 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-28T04:11:57.395 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-28T04:11:57.395 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-28T04:11:57.395 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-28T04:11:57.396 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-28T04:11:57.396 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-28T04:11:57.396 INFO:journalctl@ceph.node-exporter.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[23800]: time="2021-01-28T04:11:57Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-28T04:11:57.863 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[9867]: cluster 2021-01-28T04:11:56.878935+0000 mgr.y (mgr.14138) 323 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:57.863 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[13629]: cluster 2021-01-28T04:11:56.878935+0000 mgr.y (mgr.14138) 323 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:11:57.863 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg="Starting node_exporter (version=0.18.1, branch=HEAD, revision=3db77732e925c08f675d7404a8c46466b2ece83e)" source="node_exporter.go:156" 2021-01-28T04:11:57.863 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg="Build context (go=go1.12.5, user=root@b50852a1acba, date=20190604-16:41:18)" source="node_exporter.go:157" 2021-01-28T04:11:57.864 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg="Enabled collectors:" source="node_exporter.go:97" 2021-01-28T04:11:57.864 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - arp" source="node_exporter.go:104" 2021-01-28T04:11:57.864 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - bcache" source="node_exporter.go:104" 2021-01-28T04:11:57.864 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - bonding" source="node_exporter.go:104" 2021-01-28T04:11:57.865 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - conntrack" source="node_exporter.go:104" 2021-01-28T04:11:57.865 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - cpu" source="node_exporter.go:104" 2021-01-28T04:11:57.865 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - cpufreq" source="node_exporter.go:104" 2021-01-28T04:11:57.865 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - diskstats" source="node_exporter.go:104" 2021-01-28T04:11:57.865 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - edac" source="node_exporter.go:104" 2021-01-28T04:11:57.866 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - entropy" source="node_exporter.go:104" 2021-01-28T04:11:57.866 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - filefd" source="node_exporter.go:104" 2021-01-28T04:11:57.866 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - filesystem" source="node_exporter.go:104" 2021-01-28T04:11:57.866 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - hwmon" source="node_exporter.go:104" 2021-01-28T04:11:57.866 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - infiniband" source="node_exporter.go:104" 2021-01-28T04:11:57.867 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - ipvs" source="node_exporter.go:104" 2021-01-28T04:11:57.867 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - loadavg" source="node_exporter.go:104" 2021-01-28T04:11:57.867 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - mdadm" source="node_exporter.go:104" 2021-01-28T04:11:57.867 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - meminfo" source="node_exporter.go:104" 2021-01-28T04:11:57.867 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - netclass" source="node_exporter.go:104" 2021-01-28T04:11:57.868 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - netdev" source="node_exporter.go:104" 2021-01-28T04:11:57.868 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - netstat" source="node_exporter.go:104" 2021-01-28T04:11:57.868 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - nfs" source="node_exporter.go:104" 2021-01-28T04:11:57.868 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - nfsd" source="node_exporter.go:104" 2021-01-28T04:11:57.868 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - pressure" source="node_exporter.go:104" 2021-01-28T04:11:57.868 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - sockstat" source="node_exporter.go:104" 2021-01-28T04:11:57.869 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - stat" source="node_exporter.go:104" 2021-01-28T04:11:57.869 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - textfile" source="node_exporter.go:104" 2021-01-28T04:11:57.869 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - time" source="node_exporter.go:104" 2021-01-28T04:11:57.869 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - uname" source="node_exporter.go:104" 2021-01-28T04:11:57.869 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - vmstat" source="node_exporter.go:104" 2021-01-28T04:11:57.870 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - xfs" source="node_exporter.go:104" 2021-01-28T04:11:57.870 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg=" - zfs" source="node_exporter.go:104" 2021-01-28T04:11:57.870 INFO:journalctl@ceph.node-exporter.a.smithi150.stdout:Jan 28 04:11:57 smithi150 bash[26160]: time="2021-01-28T04:11:57Z" level=info msg="Listening on :9100" source="node_exporter.go:170" 2021-01-28T04:11:57.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:57 smithi134 bash[9858]: cluster 2021-01-28T04:11:56.878935+0000 mgr.y (mgr.14138) 323 : cluster [DBG] pgmap v248: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:00.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:11:59 smithi150 bash[9867]: cluster 2021-01-28T04:11:58.880427+0000 mgr.y (mgr.14138) 324 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:00.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:11:59 smithi150 bash[13629]: cluster 2021-01-28T04:11:58.880427+0000 mgr.y (mgr.14138) 324 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:00.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:11:59 smithi134 bash[9858]: cluster 2021-01-28T04:11:58.880427+0000 mgr.y (mgr.14138) 324 : cluster [DBG] pgmap v249: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:01.638 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:12:01 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:12:01.726 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:12:01 smithi150 bash[10146]: debug 2021-01-28T04:12:01.380+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:12:02.209 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:01 smithi150 bash[13629]: cluster 2021-01-28T04:12:00.881330+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:02.209 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:01 smithi150 bash[9867]: cluster 2021-01-28T04:12:00.881330+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:02.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:01 smithi134 bash[9858]: cluster 2021-01-28T04:12:00.881330+0000 mgr.y (mgr.14138) 325 : cluster [DBG] pgmap v250: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:02.423 INFO:teuthology.orchestra.run.smithi150.stdout:[client.0] 2021-01-28T04:12:02.424 INFO:teuthology.orchestra.run.smithi150.stdout: key = AQCSORJgs+qpGBAAyejey4sbekkDnUG+lnfc/Q== 2021-01-28T04:12:03.263 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:02 smithi150 bash[9867]: audit 2021-01-28T04:12:01.383239+0000 mgr.y (mgr.14138) 326 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:03.264 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:02 smithi150 bash[9867]: audit 2021-01-28T04:12:02.412691+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.15.150:0/3855090905' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:03.264 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:02 smithi150 bash[9867]: audit 2021-01-28T04:12:02.413409+0000 mon.a (mon.0) 592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:03.264 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:02 smithi150 bash[9867]: audit 2021-01-28T04:12:02.420108+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T04:12:03.265 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:02 smithi150 bash[13629]: audit 2021-01-28T04:12:01.383239+0000 mgr.y (mgr.14138) 326 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:03.265 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:02 smithi150 bash[13629]: audit 2021-01-28T04:12:02.412691+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.15.150:0/3855090905' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:03.265 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:02 smithi150 bash[13629]: audit 2021-01-28T04:12:02.413409+0000 mon.a (mon.0) 592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:03.265 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:02 smithi150 bash[13629]: audit 2021-01-28T04:12:02.420108+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T04:12:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:02 smithi134 bash[9858]: audit 2021-01-28T04:12:01.383239+0000 mgr.y (mgr.14138) 326 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:02 smithi134 bash[9858]: audit 2021-01-28T04:12:02.412691+0000 mon.c (mon.1) 19 : audit [INF] from='client.? 172.21.15.150:0/3855090905' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:02 smithi134 bash[9858]: audit 2021-01-28T04:12:02.413409+0000 mon.a (mon.0) 592 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:03.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:02 smithi134 bash[9858]: audit 2021-01-28T04:12:02.420108+0000 mon.a (mon.0) 593 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T04:12:04.001 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:12:04.001 DEBUG:teuthology.orchestra.run.smithi150:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2021-01-28T04:12:04.002 DEBUG:teuthology.orchestra.run.smithi150:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2021-01-28T04:12:04.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2021-01-28T04:12:04.194 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:03 smithi150 bash[9867]: cluster 2021-01-28T04:12:02.882361+0000 mgr.y (mgr.14138) 327 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:04.194 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:03 smithi150 bash[13629]: cluster 2021-01-28T04:12:02.882361+0000 mgr.y (mgr.14138) 327 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:04.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:03 smithi134 bash[9858]: cluster 2021-01-28T04:12:02.882361+0000 mgr.y (mgr.14138) 327 : cluster [DBG] pgmap v251: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:06.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:05 smithi134 bash[9858]: cluster 2021-01-28T04:12:04.883945+0000 mgr.y (mgr.14138) 328 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:06.206 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:05 smithi150 bash[9867]: cluster 2021-01-28T04:12:04.883945+0000 mgr.y (mgr.14138) 328 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:06.206 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:05 smithi150 bash[13629]: cluster 2021-01-28T04:12:04.883945+0000 mgr.y (mgr.14138) 328 : cluster [DBG] pgmap v252: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:06.476 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:06 smithi150 systemd[1]: Started Ceph alertmanager.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:12:07.824 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[13629]: audit 2021-01-28T04:12:06.477425+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:07.824 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[13629]: audit 2021-01-28T04:12:06.478932+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:07.825 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[13629]: audit 2021-01-28T04:12:06.479381+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:07.825 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[13629]: cluster 2021-01-28T04:12:06.884641+0000 mgr.y (mgr.14138) 329 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:07.826 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[9867]: audit 2021-01-28T04:12:06.477425+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:07.826 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[9867]: audit 2021-01-28T04:12:06.478932+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:07.827 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[9867]: audit 2021-01-28T04:12:06.479381+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:07.827 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[9867]: cluster 2021-01-28T04:12:06.884641+0000 mgr.y (mgr.14138) 329 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:07.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:07 smithi134 bash[9858]: audit 2021-01-28T04:12:06.477425+0000 mon.a (mon.0) 594 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:07.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:07 smithi134 bash[9858]: audit 2021-01-28T04:12:06.478932+0000 mon.a (mon.0) 595 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:07.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:07 smithi134 bash[9858]: audit 2021-01-28T04:12:06.479381+0000 mon.a (mon.0) 596 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:07.890 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:07 smithi134 bash[9858]: cluster 2021-01-28T04:12:06.884641+0000 mgr.y (mgr.14138) 329 : cluster [DBG] pgmap v253: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:07.964 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2021-01-28T04:12:07.965 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQCXORJgMPniOBAA8dKt0JE9OVeQcKAJstayEA== 2021-01-28T04:12:08.227 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:07.952Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-28T04:12:08.227 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:07.952Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-28T04:12:08.227 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:07.954Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.150 port=9094 2021-01-28T04:12:08.228 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:07.957Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-28T04:12:08.228 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:07.996Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-28T04:12:08.228 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:07 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:07.996Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-28T04:12:08.228 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:08.001Z caller=main.go:497 msg=Listening address=:9093 2021-01-28T04:12:08.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:08 smithi134 bash[9858]: audit 2021-01-28T04:12:07.954182+0000 mon.a (mon.0) 597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:08.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:08 smithi134 bash[9858]: audit 2021-01-28T04:12:07.955807+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.134:0/3115448427' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:08.813 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:08 smithi134 bash[9858]: audit 2021-01-28T04:12:07.961378+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T04:12:08.814 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:08 smithi134 bash[9858]: audit 2021-01-28T04:12:08.189190+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:08.815 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2021-01-28T04:12:08.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2021-01-28T04:12:08.815 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2021-01-28T04:12:08.837 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd dump --format=json 2021-01-28T04:12:08.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[9867]: audit 2021-01-28T04:12:07.954182+0000 mon.a (mon.0) 597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:08.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[9867]: audit 2021-01-28T04:12:07.955807+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.134:0/3115448427' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:08.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[9867]: audit 2021-01-28T04:12:07.961378+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T04:12:08.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[9867]: audit 2021-01-28T04:12:08.189190+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:08.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[13629]: audit 2021-01-28T04:12:07.954182+0000 mon.a (mon.0) 597 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:08.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[13629]: audit 2021-01-28T04:12:07.955807+0000 mon.b (mon.2) 21 : audit [INF] from='client.? 172.21.15.134:0/3115448427' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2021-01-28T04:12:08.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[13629]: audit 2021-01-28T04:12:07.961378+0000 mon.a (mon.0) 598 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2021-01-28T04:12:08.979 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:08 smithi150 bash[13629]: audit 2021-01-28T04:12:08.189190+0000 mon.a (mon.0) 599 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.002 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:09.960 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: audit 2021-01-28T04:12:08.643137+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.961 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: audit 2021-01-28T04:12:08.649206+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.961 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cephadm 2021-01-28T04:12:08.650708+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:09.961 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cephadm 2021-01-28T04:12:08.651768+0000 mgr.y (mgr.14138) 331 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:09.961 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cephadm 2021-01-28T04:12:08.652704+0000 mgr.y (mgr.14138) 332 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:09.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cephadm 2021-01-28T04:12:08.653514+0000 mgr.y (mgr.14138) 333 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:09.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cephadm 2021-01-28T04:12:08.654329+0000 mgr.y (mgr.14138) 334 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:09.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cephadm 2021-01-28T04:12:08.655169+0000 mgr.y (mgr.14138) 335 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:09.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cephadm 2021-01-28T04:12:08.656032+0000 mgr.y (mgr.14138) 336 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='a')] 2021-01-28T04:12:09.962 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: audit 2021-01-28T04:12:08.752681+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.963 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: audit 2021-01-28T04:12:08.757864+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.963 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: audit 2021-01-28T04:12:08.758749+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T04:12:09.963 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: audit 2021-01-28T04:12:08.759601+0000 mgr.y (mgr.14138) 337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T04:12:09.963 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: audit 2021-01-28T04:12:08.766293+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.964 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cephadm 2021-01-28T04:12:08.772029+0000 mgr.y (mgr.14138) 338 : cephadm [INF] Deploying daemon grafana.a on smithi134 2021-01-28T04:12:09.964 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[9867]: cluster 2021-01-28T04:12:08.885772+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:09.964 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: audit 2021-01-28T04:12:08.643137+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.964 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: audit 2021-01-28T04:12:08.649206+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.964 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cephadm 2021-01-28T04:12:08.650708+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:09.965 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cephadm 2021-01-28T04:12:08.651768+0000 mgr.y (mgr.14138) 331 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:09.965 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cephadm 2021-01-28T04:12:08.652704+0000 mgr.y (mgr.14138) 332 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:09.965 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cephadm 2021-01-28T04:12:08.653514+0000 mgr.y (mgr.14138) 333 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:09.965 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cephadm 2021-01-28T04:12:08.654329+0000 mgr.y (mgr.14138) 334 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:09.966 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cephadm 2021-01-28T04:12:08.655169+0000 mgr.y (mgr.14138) 335 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:09.966 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cephadm 2021-01-28T04:12:08.656032+0000 mgr.y (mgr.14138) 336 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='a')] 2021-01-28T04:12:09.966 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: audit 2021-01-28T04:12:08.752681+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.966 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: audit 2021-01-28T04:12:08.757864+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.966 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: audit 2021-01-28T04:12:08.758749+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T04:12:09.967 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: audit 2021-01-28T04:12:08.759601+0000 mgr.y (mgr.14138) 337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T04:12:09.967 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: audit 2021-01-28T04:12:08.766293+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:09.967 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cephadm 2021-01-28T04:12:08.772029+0000 mgr.y (mgr.14138) 338 : cephadm [INF] Deploying daemon grafana.a on smithi134 2021-01-28T04:12:09.967 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[13629]: cluster 2021-01-28T04:12:08.885772+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:10.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: audit 2021-01-28T04:12:08.643137+0000 mon.a (mon.0) 600 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:10.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: audit 2021-01-28T04:12:08.649206+0000 mon.a (mon.0) 601 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:10.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cephadm 2021-01-28T04:12:08.650708+0000 mgr.y (mgr.14138) 330 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:10.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cephadm 2021-01-28T04:12:08.651768+0000 mgr.y (mgr.14138) 331 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:10.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cephadm 2021-01-28T04:12:08.652704+0000 mgr.y (mgr.14138) 332 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:10.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cephadm 2021-01-28T04:12:08.653514+0000 mgr.y (mgr.14138) 333 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:10.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cephadm 2021-01-28T04:12:08.654329+0000 mgr.y (mgr.14138) 334 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:10.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cephadm 2021-01-28T04:12:08.655169+0000 mgr.y (mgr.14138) 335 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:10.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cephadm 2021-01-28T04:12:08.656032+0000 mgr.y (mgr.14138) 336 : cephadm [INF] Combine hosts with existing daemons [] + new hosts [HostPlacementSpec(hostname='smithi134', network='', name='a')] 2021-01-28T04:12:10.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: audit 2021-01-28T04:12:08.752681+0000 mon.a (mon.0) 602 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:10.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: audit 2021-01-28T04:12:08.757864+0000 mon.a (mon.0) 603 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:10.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: audit 2021-01-28T04:12:08.758749+0000 mon.a (mon.0) 604 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T04:12:10.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: audit 2021-01-28T04:12:08.759601+0000 mgr.y (mgr.14138) 337 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2021-01-28T04:12:10.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: audit 2021-01-28T04:12:08.766293+0000 mon.a (mon.0) 605 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:10.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cephadm 2021-01-28T04:12:08.772029+0000 mgr.y (mgr.14138) 338 : cephadm [INF] Deploying daemon grafana.a on smithi134 2021-01-28T04:12:10.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:09 smithi134 bash[9858]: cluster 2021-01-28T04:12:08.885772+0000 mgr.y (mgr.14138) 339 : cluster [DBG] pgmap v254: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:10.227 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:09 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:09.958Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000190833s 2021-01-28T04:12:11.727 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:12:11 smithi150 bash[10146]: debug 2021-01-28T04:12:11.387+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:12:11.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:12:11 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:12:12.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:11 smithi150 bash[13629]: cluster 2021-01-28T04:12:10.886707+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:12.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:11 smithi150 bash[9867]: cluster 2021-01-28T04:12:10.886707+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:12.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:11 smithi134 bash[9858]: cluster 2021-01-28T04:12:10.886707+0000 mgr.y (mgr.14138) 340 : cluster [DBG] pgmap v255: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:12.611 INFO:teuthology.orchestra.run.smithi150.stdout: 2021-01-28T04:12:12.611 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":60,"fsid":"d0bb049a-611d-11eb-8f9e-001a4aab830c","created":"2021-01-28T04:04:23.619965+0000","modified":"2021-01-28T04:11:22.669661+0000","last_up_change":"2021-01-28T04:10:58.320027+0000","last_in_change":"2021-01-28T04:10:58.320027+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-28T04:06:14.504783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-28T04:10:53.215307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-28T04:11:13.526611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-28T04:11:14.189420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-28T04:11:16.060464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-28T04:11:19.137332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"dbd745cc-a38a-42b7-beb3-7c3d2fcb148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6803","nonce":2923371016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6805","nonce":2923371016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6809","nonce":2923371016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6807","nonce":2923371016}]},"public_addr":"172.21.15.150:6803/2923371016","cluster_addr":"172.21.15.150:6805/2923371016","heartbeat_back_addr":"172.21.15.150:6809/2923371016","heartbeat_front_addr":"172.21.15.150:6807/2923371016","state":["exists","up"]},{"osd":1,"uuid":"9d3c3014-f0c7-4677-aaec-847874e216d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6811","nonce":2659937724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6813","nonce":2659937724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6817","nonce":2659937724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6815","nonce":2659937724}]},"public_addr":"172.21.15.150:6811/2659937724","cluster_addr":"172.21.15.150:6813/2659937724","heartbeat_back_addr":"172.21.15.150:6817/2659937724","heartbeat_front_addr":"172.21.15.150:6815/2659937724","state":["exists","up"]},{"osd":2,"uuid":"8ad36a92-9bcf-44fa-8132-698ca0c8f0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6819","nonce":1301223535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6821","nonce":1301223535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6825","nonce":1301223535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6823","nonce":1301223535}]},"public_addr":"172.21.15.150:6819/1301223535","cluster_addr":"172.21.15.150:6821/1301223535","heartbeat_back_addr":"172.21.15.150:6825/1301223535","heartbeat_front_addr":"172.21.15.150:6823/1301223535","state":["exists","up"]},{"osd":3,"uuid":"dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6827","nonce":3623645746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6829","nonce":3623645746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6833","nonce":3623645746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6831","nonce":3623645746}]},"public_addr":"172.21.15.150:6827/3623645746","cluster_addr":"172.21.15.150:6829/3623645746","heartbeat_back_addr":"172.21.15.150:6833/3623645746","heartbeat_front_addr":"172.21.15.150:6831/3623645746","state":["exists","up"]},{"osd":4,"uuid":"6435dc9d-5222-464a-af64-6c0dad1c65ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6801","nonce":2281694848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6803","nonce":2281694848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6807","nonce":2281694848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6805","nonce":2281694848}]},"public_addr":"172.21.15.134:6801/2281694848","cluster_addr":"172.21.15.134:6803/2281694848","heartbeat_back_addr":"172.21.15.134:6807/2281694848","heartbeat_front_addr":"172.21.15.134:6805/2281694848","state":["exists","up"]},{"osd":5,"uuid":"d31b1648-1ba1-4895-b27f-9182737d7b30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6809","nonce":2513989983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6811","nonce":2513989983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6815","nonce":2513989983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6813","nonce":2513989983}]},"public_addr":"172.21.15.134:6809/2513989983","cluster_addr":"172.21.15.134:6811/2513989983","heartbeat_back_addr":"172.21.15.134:6815/2513989983","heartbeat_front_addr":"172.21.15.134:6813/2513989983","state":["exists","up"]},{"osd":6,"uuid":"ba50ffef-fcbd-4944-8e0a-bf1c085192b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6817","nonce":1369484950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6819","nonce":1369484950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6823","nonce":1369484950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6821","nonce":1369484950}]},"public_addr":"172.21.15.134:6817/1369484950","cluster_addr":"172.21.15.134:6819/1369484950","heartbeat_back_addr":"172.21.15.134:6823/1369484950","heartbeat_front_addr":"172.21.15.134:6821/1369484950","state":["exists","up"]},{"osd":7,"uuid":"6817eafa-ca23-4efe-a5fa-b83d5c6f387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6825","nonce":1198397315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6827","nonce":1198397315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6831","nonce":1198397315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6829","nonce":1198397315}]},"public_addr":"172.21.15.134:6825/1198397315","cluster_addr":"172.21.15.134:6827/1198397315","heartbeat_back_addr":"172.21.15.134:6831/1198397315","heartbeat_front_addr":"172.21.15.134:6829/1198397315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:07:34.961688+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:08:04.329930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:08:34.491913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:01.256035+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:27.576021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:56.353445+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:10:25.746147+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:10:56.708110+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/317046192":"2021-01-29T04:05:20.700594+0000","172.21.15.150:0/3174208176":"2021-01-29T04:05:20.700594+0000","172.21.15.150:6800/317046192":"2021-01-29T04:05:20.700594+0000","172.21.15.150:0/3728750765":"2021-01-29T04:05:20.700594+0000","172.21.15.150:6800/2805633800":"2021-01-29T04:04:58.368207+0000","172.21.15.150:6801/2805633800":"2021-01-29T04:04:58.368207+0000","172.21.15.150:0/1702946609":"2021-01-29T04:04:58.368207+0000","172.21.15.150:0/1046813580":"2021-01-29T04:04:58.368207+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-28T04:12:13.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:12 smithi150 bash[9867]: audit 2021-01-28T04:12:11.391170+0000 mgr.y (mgr.14138) 341 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:13.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:12 smithi150 bash[9867]: audit 2021-01-28T04:12:12.606692+0000 mon.a (mon.0) 606 : audit [DBG] from='client.? 172.21.15.150:0/2027168343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:12:13.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:12 smithi150 bash[13629]: audit 2021-01-28T04:12:11.391170+0000 mgr.y (mgr.14138) 341 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:13.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:12 smithi150 bash[13629]: audit 2021-01-28T04:12:12.606692+0000 mon.a (mon.0) 606 : audit [DBG] from='client.? 172.21.15.150:0/2027168343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:12:13.387 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2021-01-28T04:06:14.504783+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': '.rgw.root', 'create_time': '2021-01-28T04:10:53.215307+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '46', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 3, 'pool_name': 'iscsi', 'create_time': '2021-01-28T04:11:13.526611+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 3, 'pg_placement_num': 3, 'pg_placement_num_target': 3, 'pg_num_target': 3, 'pg_num_pending': 3, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 4, 'pool_name': 'zone.rgw.log', 'create_time': '2021-01-28T04:11:14.189420+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '54', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 5, 'pool_name': 'zone.rgw.control', 'create_time': '2021-01-28T04:11:16.060464+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '56', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}}, {'pool': 6, 'pool_name': 'zone.rgw.meta', 'create_time': '2021-01-28T04:11:19.137332+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '60', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 8}, 'application_metadata': {'rgw': {}}}] 2021-01-28T04:12:13.388 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd pool get device_health_metrics pg_num 2021-01-28T04:12:13.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:12 smithi134 bash[9858]: audit 2021-01-28T04:12:11.391170+0000 mgr.y (mgr.14138) 341 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:13.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:12 smithi134 bash[9858]: audit 2021-01-28T04:12:12.606692+0000 mon.a (mon.0) 606 : audit [DBG] from='client.? 172.21.15.150:0/2027168343' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:12:13.542 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:14.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:13 smithi150 bash[13629]: cluster 2021-01-28T04:12:12.887804+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:14.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:13 smithi150 bash[9867]: cluster 2021-01-28T04:12:12.887804+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:14.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:13 smithi134 bash[9858]: cluster 2021-01-28T04:12:12.887804+0000 mgr.y (mgr.14138) 342 : cluster [DBG] pgmap v256: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:15.964 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:15 smithi150 bash[13629]: cluster 2021-01-28T04:12:14.889418+0000 mgr.y (mgr.14138) 343 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:16.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:15 smithi150 bash[9867]: cluster 2021-01-28T04:12:14.889418+0000 mgr.y (mgr.14138) 343 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:16.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:15 smithi134 bash[9858]: cluster 2021-01-28T04:12:14.889418+0000 mgr.y (mgr.14138) 343 : cluster [DBG] pgmap v257: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:17.109 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 1 2021-01-28T04:12:17.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:17 smithi134 bash[9858]: cluster 2021-01-28T04:12:16.890120+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:17.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:17 smithi134 bash[9858]: audit 2021-01-28T04:12:17.107052+0000 mon.a (mon.0) 607 : audit [DBG] from='client.? 172.21.15.150:0/4101858219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-28T04:12:17.897 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:17 smithi150 bash[13629]: cluster 2021-01-28T04:12:16.890120+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:17.897 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:17 smithi150 bash[13629]: audit 2021-01-28T04:12:17.107052+0000 mon.a (mon.0) 607 : audit [DBG] from='client.? 172.21.15.150:0/4101858219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-28T04:12:17.897 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:17 smithi150 bash[9867]: cluster 2021-01-28T04:12:16.890120+0000 mgr.y (mgr.14138) 344 : cluster [DBG] pgmap v258: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:17.898 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:17 smithi150 bash[9867]: audit 2021-01-28T04:12:17.107052+0000 mon.a (mon.0) 607 : audit [DBG] from='client.? 172.21.15.150:0/4101858219' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2021-01-28T04:12:17.898 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd pool get .rgw.root pg_num 2021-01-28T04:12:18.055 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:18.227 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:17 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:17.959Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.00121503s 2021-01-28T04:12:20.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:19 smithi150 bash[9867]: cluster 2021-01-28T04:12:18.891564+0000 mgr.y (mgr.14138) 345 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:20.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:19 smithi150 bash[13629]: cluster 2021-01-28T04:12:18.891564+0000 mgr.y (mgr.14138) 345 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:20.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:19 smithi134 bash[9858]: cluster 2021-01-28T04:12:18.891564+0000 mgr.y (mgr.14138) 345 : cluster [DBG] pgmap v259: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:21.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:20 smithi150 bash[9867]: audit 2021-01-28T04:12:20.797658+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-01-28T04:12:21.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:20 smithi150 bash[9867]: audit 2021-01-28T04:12:20.798407+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-01-28T04:12:21.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:20 smithi150 bash[9867]: audit 2021-01-28T04:12:20.798961+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-01-28T04:12:21.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:20 smithi150 bash[9867]: audit 2021-01-28T04:12:20.799379+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-01-28T04:12:21.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:20 smithi150 bash[13629]: audit 2021-01-28T04:12:20.797658+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-01-28T04:12:21.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:20 smithi150 bash[13629]: audit 2021-01-28T04:12:20.798407+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-01-28T04:12:21.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:20 smithi150 bash[13629]: audit 2021-01-28T04:12:20.798961+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-01-28T04:12:21.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:20 smithi150 bash[13629]: audit 2021-01-28T04:12:20.799379+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-01-28T04:12:21.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:20 smithi134 bash[9858]: audit 2021-01-28T04:12:20.797658+0000 mon.a (mon.0) 608 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]: dispatch 2021-01-28T04:12:21.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:20 smithi134 bash[9858]: audit 2021-01-28T04:12:20.798407+0000 mon.a (mon.0) 609 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]: dispatch 2021-01-28T04:12:21.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:20 smithi134 bash[9858]: audit 2021-01-28T04:12:20.798961+0000 mon.a (mon.0) 610 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]: dispatch 2021-01-28T04:12:21.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:20 smithi134 bash[9858]: audit 2021-01-28T04:12:20.799379+0000 mon.a (mon.0) 611 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]: dispatch 2021-01-28T04:12:21.411 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2021-01-28T04:12:21.727 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[10146]: debug 2021-01-28T04:12:21.394+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:12:21.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:12:22.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: cluster 2021-01-28T04:12:20.892390+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:28.739 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: audit 2021-01-28T04:12:20.968950+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2021-01-28T04:12:28.739 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: audit 2021-01-28T04:12:20.969107+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]': finished 2021-01-28T04:12:28.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: audit 2021-01-28T04:12:20.969257+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2021-01-28T04:12:28.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: audit 2021-01-28T04:12:20.969374+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]': finished 2021-01-28T04:12:28.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: cluster 2021-01-28T04:12:20.969477+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-28T04:12:28.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: audit 2021-01-28T04:12:20.972306+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:12:28.740 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: audit 2021-01-28T04:12:20.973497+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:12:28.741 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[9867]: audit 2021-01-28T04:12:21.409251+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.150:0/2731663302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-28T04:12:28.741 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: cluster 2021-01-28T04:12:20.892390+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:28.741 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: audit 2021-01-28T04:12:20.968950+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2021-01-28T04:12:28.741 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: audit 2021-01-28T04:12:20.969107+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]': finished 2021-01-28T04:12:28.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: audit 2021-01-28T04:12:20.969257+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2021-01-28T04:12:28.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: audit 2021-01-28T04:12:20.969374+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]': finished 2021-01-28T04:12:28.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: cluster 2021-01-28T04:12:20.969477+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-28T04:12:28.742 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: audit 2021-01-28T04:12:20.972306+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:12:28.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: audit 2021-01-28T04:12:20.973497+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:12:28.743 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:21 smithi150 bash[13629]: audit 2021-01-28T04:12:21.409251+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.150:0/2731663302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-28T04:12:28.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: cluster 2021-01-28T04:12:20.892390+0000 mgr.y (mgr.14138) 346 : cluster [DBG] pgmap v260: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:28.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: audit 2021-01-28T04:12:20.968950+0000 mon.a (mon.0) 612 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.e", "id": [7, 4]}]': finished 2021-01-28T04:12:28.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: audit 2021-01-28T04:12:20.969107+0000 mon.a (mon.0) 613 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.7", "id": [1, 2]}]': finished 2021-01-28T04:12:28.748 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: audit 2021-01-28T04:12:20.969257+0000 mon.a (mon.0) 614 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.a", "id": [1, 2]}]': finished 2021-01-28T04:12:28.748 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: audit 2021-01-28T04:12:20.969374+0000 mon.a (mon.0) 615 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [1, 5]}]': finished 2021-01-28T04:12:28.748 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: cluster 2021-01-28T04:12:20.969477+0000 mon.a (mon.0) 616 : cluster [DBG] osdmap e61: 8 total, 8 up, 8 in 2021-01-28T04:12:28.748 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: audit 2021-01-28T04:12:20.972306+0000 mon.a (mon.0) 617 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:12:28.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: audit 2021-01-28T04:12:20.973497+0000 mon.a (mon.0) 618 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:12:28.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:21 smithi134 bash[9858]: audit 2021-01-28T04:12:21.409251+0000 mon.a (mon.0) 619 : audit [DBG] from='client.? 172.21.15.150:0/2731663302' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".rgw.root", "var": "pg_num"}]: dispatch 2021-01-28T04:12:28.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:22 smithi134 bash[9858]: audit 2021-01-28T04:12:21.398900+0000 mgr.y (mgr.14138) 347 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:28.749 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:22 smithi134 bash[9858]: cluster 2021-01-28T04:12:21.979397+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-28T04:12:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:23 smithi134 bash[9858]: cluster 2021-01-28T04:12:22.893230+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 80 B/s, 0 objects/s recovering 2021-01-28T04:12:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:24 smithi134 bash[9858]: cluster 2021-01-28T04:12:24.894688+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:28.750 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[9858]: audit 2021-01-28T04:12:25.553899+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.751 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[9858]: audit 2021-01-28T04:12:25.557477+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:28.752 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[9858]: audit 2021-01-28T04:12:25.558247+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:28.752 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[9858]: cluster 2021-01-28T04:12:26.895419+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:28.752 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[9858]: audit 2021-01-28T04:12:27.127589+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.753 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:25 smithi134 systemd[1]: Started Ceph grafana.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:12:28.753 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Starting Grafana" logger=server version=6.7.4 commit=8e44bbc5f5 branch=HEAD compiled=2020-05-26T17:35:38+0000 2021-01-28T04:12:28.754 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2021-01-28T04:12:28.754 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2021-01-28T04:12:28.754 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2021-01-28T04:12:28.755 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2021-01-28T04:12:28.755 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2021-01-28T04:12:28.756 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2021-01-28T04:12:28.756 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2021-01-28T04:12:28.756 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2021-01-28T04:12:28.757 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2021-01-28T04:12:28.757 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2021-01-28T04:12:28.758 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2021-01-28T04:12:28.758 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="App mode production" logger=settings 2021-01-28T04:12:28.758 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Initializing SqlStore" logger=server 2021-01-28T04:12:28.759 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2021-01-28T04:12:28.760 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Starting DB migration" logger=migrator 2021-01-28T04:12:28.760 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2021-01-28T04:12:28.760 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:26 smithi134 bash[24619]: t=2021-01-28T04:12:26+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2021-01-28T04:12:28.761 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2021-01-28T04:12:28.761 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2021-01-28T04:12:28.761 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2021-01-28T04:12:28.762 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2021-01-28T04:12:28.762 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2021-01-28T04:12:28.763 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2021-01-28T04:12:28.763 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2021-01-28T04:12:28.763 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2021-01-28T04:12:28.764 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-28T04:12:28.764 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2021-01-28T04:12:28.765 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2021-01-28T04:12:28.765 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2021-01-28T04:12:28.765 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2021-01-28T04:12:28.766 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2021-01-28T04:12:28.766 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2021-01-28T04:12:28.767 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:27 smithi134 bash[24619]: t=2021-01-28T04:12:27+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2021-01-28T04:12:28.767 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2021-01-28T04:12:28.767 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2021-01-28T04:12:28.768 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2021-01-28T04:12:28.768 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2021-01-28T04:12:28.768 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2021-01-28T04:12:28.769 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2021-01-28T04:12:28.769 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2021-01-28T04:12:28.770 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd pool get iscsi pg_num 2021-01-28T04:12:28.774 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:22 smithi150 bash[9867]: audit 2021-01-28T04:12:21.398900+0000 mgr.y (mgr.14138) 347 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:28.774 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:22 smithi150 bash[9867]: cluster 2021-01-28T04:12:21.979397+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-28T04:12:28.775 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:23 smithi150 bash[9867]: cluster 2021-01-28T04:12:22.893230+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 80 B/s, 0 objects/s recovering 2021-01-28T04:12:28.775 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:24 smithi150 bash[9867]: cluster 2021-01-28T04:12:24.894688+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:28.776 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:26 smithi150 bash[9867]: audit 2021-01-28T04:12:25.553899+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.776 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:26 smithi150 bash[9867]: audit 2021-01-28T04:12:25.557477+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:28.777 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:26 smithi150 bash[9867]: audit 2021-01-28T04:12:25.558247+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:28.777 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:27 smithi150 bash[9867]: cluster 2021-01-28T04:12:26.895419+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:28.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:27 smithi150 bash[9867]: audit 2021-01-28T04:12:27.127589+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:28 smithi150 bash[9867]: audit 2021-01-28T04:12:27.608421+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:28 smithi150 bash[9867]: cephadm 2021-01-28T04:12:27.609875+0000 mgr.y (mgr.14138) 351 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:12:28.778 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:28 smithi150 bash[9867]: audit 2021-01-28T04:12:28.018548+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:22 smithi150 bash[13629]: audit 2021-01-28T04:12:21.398900+0000 mgr.y (mgr.14138) 347 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:28.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:22 smithi150 bash[13629]: cluster 2021-01-28T04:12:21.979397+0000 mon.a (mon.0) 620 : cluster [DBG] osdmap e62: 8 total, 8 up, 8 in 2021-01-28T04:12:28.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:23 smithi150 bash[13629]: cluster 2021-01-28T04:12:22.893230+0000 mgr.y (mgr.14138) 348 : cluster [DBG] pgmap v263: 132 pgs: 132 active+clean; 25 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 80 B/s, 0 objects/s recovering 2021-01-28T04:12:28.779 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:24 smithi150 bash[13629]: cluster 2021-01-28T04:12:24.894688+0000 mgr.y (mgr.14138) 349 : cluster [DBG] pgmap v264: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:28.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:26 smithi150 bash[13629]: audit 2021-01-28T04:12:25.553899+0000 mon.a (mon.0) 621 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:26 smithi150 bash[13629]: audit 2021-01-28T04:12:25.557477+0000 mon.a (mon.0) 622 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:28.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:26 smithi150 bash[13629]: audit 2021-01-28T04:12:25.558247+0000 mon.a (mon.0) 623 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:28.780 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:27 smithi150 bash[13629]: cluster 2021-01-28T04:12:26.895419+0000 mgr.y (mgr.14138) 350 : cluster [DBG] pgmap v265: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:28.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:27 smithi150 bash[13629]: audit 2021-01-28T04:12:27.127589+0000 mon.a (mon.0) 624 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:28 smithi150 bash[13629]: audit 2021-01-28T04:12:27.608421+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:28 smithi150 bash[13629]: cephadm 2021-01-28T04:12:27.609875+0000 mgr.y (mgr.14138) 351 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:12:28.781 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:28 smithi150 bash[13629]: audit 2021-01-28T04:12:28.018548+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[9858]: audit 2021-01-28T04:12:27.608421+0000 mon.a (mon.0) 625 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[9858]: cephadm 2021-01-28T04:12:27.609875+0000 mgr.y (mgr.14138) 351 : cephadm [INF] refreshing smithi134 facts 2021-01-28T04:12:28.842 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[9858]: audit 2021-01-28T04:12:28.018548+0000 mon.a (mon.0) 626 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:28.843 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2021-01-28T04:12:28.843 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2021-01-28T04:12:28.843 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2021-01-28T04:12:28.843 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2021-01-28T04:12:28.936 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:29.135 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2021-01-28T04:12:29.135 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2021-01-28T04:12:29.135 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:28 smithi134 bash[24619]: t=2021-01-28T04:12:28+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2021-01-28T04:12:29.135 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2021-01-28T04:12:29.388 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2021-01-28T04:12:29.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2021-01-28T04:12:29.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2021-01-28T04:12:29.390 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2021-01-28T04:12:29.768 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2021-01-28T04:12:29.769 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2021-01-28T04:12:29.769 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2021-01-28T04:12:29.770 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2021-01-28T04:12:29.770 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2021-01-28T04:12:29.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.020777+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:29.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.021500+0000 mgr.y (mgr.14138) 353 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:29.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.022032+0000 mgr.y (mgr.14138) 354 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:29.772 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.022545+0000 mgr.y (mgr.14138) 355 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.772 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.023091+0000 mgr.y (mgr.14138) 356 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:29.773 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.023607+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.773 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.024119+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.774 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.025514+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-28T04:12:29.774 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cephadm 2021-01-28T04:12:28.029860+0000 mgr.y (mgr.14138) 360 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi150 2021-01-28T04:12:29.774 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[9858]: cluster 2021-01-28T04:12:28.896875+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:29.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.020777+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:29.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.021500+0000 mgr.y (mgr.14138) 353 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:29.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.022032+0000 mgr.y (mgr.14138) 354 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:29.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.022545+0000 mgr.y (mgr.14138) 355 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.023091+0000 mgr.y (mgr.14138) 356 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:29.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.023607+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.024119+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.025514+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-28T04:12:29.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cephadm 2021-01-28T04:12:28.029860+0000 mgr.y (mgr.14138) 360 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi150 2021-01-28T04:12:29.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[9867]: cluster 2021-01-28T04:12:28.896875+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:29.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.020777+0000 mgr.y (mgr.14138) 352 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:29.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.021500+0000 mgr.y (mgr.14138) 353 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:29.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.022032+0000 mgr.y (mgr.14138) 354 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:29.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.022545+0000 mgr.y (mgr.14138) 355 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.023091+0000 mgr.y (mgr.14138) 356 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:29.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.023607+0000 mgr.y (mgr.14138) 357 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.983 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.024119+0000 mgr.y (mgr.14138) 358 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:29.983 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.025514+0000 mgr.y (mgr.14138) 359 : cephadm [INF] Reconfiguring alertmanager.a (dependencies changed)... 2021-01-28T04:12:29.983 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cephadm 2021-01-28T04:12:28.029860+0000 mgr.y (mgr.14138) 360 : cephadm [INF] Reconfiguring daemon alertmanager.a on smithi150 2021-01-28T04:12:29.983 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:29 smithi150 bash[13629]: cluster 2021-01-28T04:12:28.896875+0000 mgr.y (mgr.14138) 361 : cluster [DBG] pgmap v266: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s; 264 B/s, 3 objects/s recovering 2021-01-28T04:12:30.073 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2021-01-28T04:12:30.073 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2021-01-28T04:12:30.074 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:29 smithi134 bash[24619]: t=2021-01-28T04:12:29+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2021-01-28T04:12:30.366 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2021-01-28T04:12:30.366 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2021-01-28T04:12:30.367 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2021-01-28T04:12:30.367 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2021-01-28T04:12:30.638 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2021-01-28T04:12:30.639 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2021-01-28T04:12:30.639 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2021-01-28T04:12:30.639 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2021-01-28T04:12:30.961 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2021-01-28T04:12:30.961 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2021-01-28T04:12:30.961 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2021-01-28T04:12:30.961 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2021-01-28T04:12:31.254 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:30 smithi134 bash[24619]: t=2021-01-28T04:12:30+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2021-01-28T04:12:31.254 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2021-01-28T04:12:31.254 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2021-01-28T04:12:31.254 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2021-01-28T04:12:31.476 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:12:31 smithi150 bash[10146]: debug 2021-01-28T04:12:31.406+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:12:31.539 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:12:31.539 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2021-01-28T04:12:31.539 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2021-01-28T04:12:31.540 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2021-01-28T04:12:31.540 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2021-01-28T04:12:31.790 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2021-01-28T04:12:31.791 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2021-01-28T04:12:31.791 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2021-01-28T04:12:31.791 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2021-01-28T04:12:31.791 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2021-01-28T04:12:32.092 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[9858]: cluster 2021-01-28T04:12:30.897736+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s; 212 B/s, 3 objects/s recovering 2021-01-28T04:12:32.092 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2021-01-28T04:12:32.093 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:31 smithi134 bash[24619]: t=2021-01-28T04:12:31+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2021-01-28T04:12:32.093 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2021-01-28T04:12:32.262 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:31 smithi150 bash[9867]: cluster 2021-01-28T04:12:30.897736+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s; 212 B/s, 3 objects/s recovering 2021-01-28T04:12:32.263 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:31 smithi150 bash[13629]: cluster 2021-01-28T04:12:30.897736+0000 mgr.y (mgr.14138) 362 : cluster [DBG] pgmap v267: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s; 212 B/s, 3 objects/s recovering 2021-01-28T04:12:32.352 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2021-01-28T04:12:32.352 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2021-01-28T04:12:32.353 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2021-01-28T04:12:32.353 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2021-01-28T04:12:32.636 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2021-01-28T04:12:32.637 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2021-01-28T04:12:32.637 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2021-01-28T04:12:32.637 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2021-01-28T04:12:32.638 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2021-01-28T04:12:32.888 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2021-01-28T04:12:32.888 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2021-01-28T04:12:32.889 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2021-01-28T04:12:32.889 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2021-01-28T04:12:33.190 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[9858]: audit 2021-01-28T04:12:31.409895+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:33.190 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2021-01-28T04:12:33.191 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:32 smithi134 bash[24619]: t=2021-01-28T04:12:32+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2021-01-28T04:12:33.191 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2021-01-28T04:12:33.191 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2021-01-28T04:12:33.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:32 smithi150 bash[13629]: audit 2021-01-28T04:12:31.409895+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:33.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:32 smithi150 bash[9867]: audit 2021-01-28T04:12:31.409895+0000 mgr.y (mgr.14138) 363 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:33.458 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2021-01-28T04:12:33.458 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2021-01-28T04:12:33.458 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2021-01-28T04:12:33.709 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2021-01-28T04:12:33.709 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2021-01-28T04:12:33.709 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2021-01-28T04:12:33.970 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2021-01-28T04:12:33.970 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2021-01-28T04:12:33.970 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2021-01-28T04:12:33.971 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[24619]: t=2021-01-28T04:12:33+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2021-01-28T04:12:34.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:33 smithi150 bash[9867]: cluster 2021-01-28T04:12:32.898756+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 843 B/s rd, 0 op/s; 193 B/s, 2 objects/s recovering 2021-01-28T04:12:34.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:33 smithi150 bash[13629]: cluster 2021-01-28T04:12:32.898756+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 843 B/s rd, 0 op/s; 193 B/s, 2 objects/s recovering 2021-01-28T04:12:34.229 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:33 smithi134 bash[9858]: cluster 2021-01-28T04:12:32.898756+0000 mgr.y (mgr.14138) 364 : cluster [DBG] pgmap v268: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 843 B/s rd, 0 op/s; 193 B/s, 2 objects/s recovering 2021-01-28T04:12:34.229 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2021-01-28T04:12:34.229 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2021-01-28T04:12:34.230 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2021-01-28T04:12:34.488 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2021-01-28T04:12:34.489 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2021-01-28T04:12:34.489 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2021-01-28T04:12:34.489 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2021-01-28T04:12:34.748 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2021-01-28T04:12:34.748 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2021-01-28T04:12:34.748 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2021-01-28T04:12:34.845 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 3 2021-01-28T04:12:35.016 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[9858]: audit 2021-01-28T04:12:34.842113+0000 mon.a (mon.0) 627 : audit [DBG] from='client.? 172.21.15.150:0/1544091115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-28T04:12:35.017 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2021-01-28T04:12:35.017 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2021-01-28T04:12:35.017 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2021-01-28T04:12:35.017 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:34 smithi134 bash[24619]: t=2021-01-28T04:12:34+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2021-01-28T04:12:35.018 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2021-01-28T04:12:35.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:34 smithi150 bash[9867]: audit 2021-01-28T04:12:34.842113+0000 mon.a (mon.0) 627 : audit [DBG] from='client.? 172.21.15.150:0/1544091115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-28T04:12:35.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:34 smithi150 bash[13629]: audit 2021-01-28T04:12:34.842113+0000 mon.a (mon.0) 627 : audit [DBG] from='client.? 172.21.15.150:0/1544091115' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "iscsi", "var": "pg_num"}]: dispatch 2021-01-28T04:12:35.276 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2021-01-28T04:12:35.276 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2021-01-28T04:12:35.276 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2021-01-28T04:12:35.577 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2021-01-28T04:12:35.578 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2021-01-28T04:12:35.578 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2021-01-28T04:12:35.578 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2021-01-28T04:12:35.837 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2021-01-28T04:12:35.838 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2021-01-28T04:12:35.838 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2021-01-28T04:12:35.838 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2021-01-28T04:12:35.838 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2021-01-28T04:12:36.117 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[9858]: cluster 2021-01-28T04:12:34.900074+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 122 B/s, 1 objects/s recovering 2021-01-28T04:12:36.117 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2021-01-28T04:12:36.118 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:35 smithi134 bash[24619]: t=2021-01-28T04:12:35+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2021-01-28T04:12:36.118 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2021-01-28T04:12:36.177 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd pool get zone.rgw.log pg_num 2021-01-28T04:12:36.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:35 smithi150 bash[13629]: cluster 2021-01-28T04:12:34.900074+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 122 B/s, 1 objects/s recovering 2021-01-28T04:12:36.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:35 smithi150 bash[9867]: cluster 2021-01-28T04:12:34.900074+0000 mgr.y (mgr.14138) 365 : cluster [DBG] pgmap v269: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s; 122 B/s, 1 objects/s recovering 2021-01-28T04:12:36.229 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:35 smithi150 systemd[1]: Stopping Ceph alertmanager.a for d0bb049a-611d-11eb-8f9e-001a4aab830c... 2021-01-28T04:12:36.230 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:36 smithi150 bash[26722]: level=info ts=2021-01-28T04:12:36.124Z caller=main.go:536 msg="Received SIGTERM, exiting gracefully..." 2021-01-28T04:12:36.321 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:36.388 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2021-01-28T04:12:36.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2021-01-28T04:12:36.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2021-01-28T04:12:36.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2021-01-28T04:12:36.725 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2021-01-28T04:12:36.726 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2021-01-28T04:12:36.726 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2021-01-28T04:12:36.726 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2021-01-28T04:12:37.002 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2021-01-28T04:12:37.003 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2021-01-28T04:12:37.003 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2021-01-28T04:12:37.003 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:36 smithi134 bash[24619]: t=2021-01-28T04:12:36+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2021-01-28T04:12:37.278 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2021-01-28T04:12:37.279 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2021-01-28T04:12:37.279 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2021-01-28T04:12:37.279 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2021-01-28T04:12:37.279 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2021-01-28T04:12:37.580 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2021-01-28T04:12:37.581 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2021-01-28T04:12:37.581 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2021-01-28T04:12:37.619 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:37 smithi150 docker[28118]: ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c-alertmanager.a 2021-01-28T04:12:37.620 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:37 smithi150 systemd[1]: ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@alertmanager.a.service: Succeeded. 2021-01-28T04:12:37.620 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:37 smithi150 systemd[1]: Stopped Ceph alertmanager.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:12:37.620 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:37 smithi150 systemd[1]: Started Ceph alertmanager.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:12:37.831 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2021-01-28T04:12:37.832 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2021-01-28T04:12:37.832 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2021-01-28T04:12:37.832 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[9858]: cluster 2021-01-28T04:12:36.900861+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:37.833 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[9858]: audit 2021-01-28T04:12:37.526305+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:37.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:37 smithi150 bash[9867]: cluster 2021-01-28T04:12:36.900861+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:37.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:37 smithi150 bash[9867]: audit 2021-01-28T04:12:37.526305+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:37.980 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:37 smithi150 bash[13629]: cluster 2021-01-28T04:12:36.900861+0000 mgr.y (mgr.14138) 366 : cluster [DBG] pgmap v270: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:37.980 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:37 smithi150 bash[13629]: audit 2021-01-28T04:12:37.526305+0000 mon.a (mon.0) 628 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:38.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2021-01-28T04:12:38.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:37 smithi134 bash[24619]: t=2021-01-28T04:12:37+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2021-01-28T04:12:38.342 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:38 smithi134 bash[24619]: t=2021-01-28T04:12:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2021-01-28T04:12:38.633 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:38 smithi134 bash[24619]: t=2021-01-28T04:12:38+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2021-01-28T04:12:38.762 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:38 smithi150 bash[13629]: cephadm 2021-01-28T04:12:37.533341+0000 mgr.y (mgr.14138) 367 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-28T04:12:38.763 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:38 smithi150 bash[13629]: cephadm 2021-01-28T04:12:37.536657+0000 mgr.y (mgr.14138) 368 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi134 2021-01-28T04:12:38.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:38 smithi150 bash[9867]: cephadm 2021-01-28T04:12:37.533341+0000 mgr.y (mgr.14138) 367 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-28T04:12:38.763 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:38 smithi150 bash[9867]: cephadm 2021-01-28T04:12:37.536657+0000 mgr.y (mgr.14138) 368 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi134 2021-01-28T04:12:38.888 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:38 smithi134 bash[24619]: t=2021-01-28T04:12:38+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2021-01-28T04:12:38.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:38 smithi134 bash[9858]: cephadm 2021-01-28T04:12:37.533341+0000 mgr.y (mgr.14138) 367 : cephadm [INF] Reconfiguring prometheus.a (dependencies changed)... 2021-01-28T04:12:38.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:38 smithi134 bash[9858]: cephadm 2021-01-28T04:12:37.536657+0000 mgr.y (mgr.14138) 368 : cephadm [INF] Reconfiguring daemon prometheus.a on smithi134 2021-01-28T04:12:39.611 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:39 smithi134 bash[24619]: t=2021-01-28T04:12:39+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2021-01-28T04:12:39.611 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:39 smithi134 bash[24619]: t=2021-01-28T04:12:39+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2021-01-28T04:12:39.888 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:39 smithi134 bash[24619]: t=2021-01-28T04:12:39+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2021-01-28T04:12:39.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:39 smithi134 bash[9858]: cluster 2021-01-28T04:12:38.901993+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:39.897 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:39 smithi150 bash[9867]: cluster 2021-01-28T04:12:38.901993+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:39.897 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:39 smithi150 bash[13629]: cluster 2021-01-28T04:12:38.901993+0000 mgr.y (mgr.14138) 369 : cluster [DBG] pgmap v271: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:40.225 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:39 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:39.981Z caller=main.go:231 msg="Starting Alertmanager" version="(version=0.20.0, branch=HEAD, revision=f74be0400a6243d10bb53812d6fa408ad71ff32d)" 2021-01-28T04:12:40.226 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:39 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:39.981Z caller=main.go:232 build_context="(go=go1.13.5, user=root@00c3106655f8, date=20191211-14:13:14)" 2021-01-28T04:12:40.226 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:39 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:39.983Z caller=cluster.go:161 component=cluster msg="setting advertise address explicitly" addr=172.21.15.150 port=9094 2021-01-28T04:12:40.226 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:39 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:39.984Z caller=cluster.go:623 component=cluster msg="Waiting for gossip to settle..." interval=2s 2021-01-28T04:12:40.227 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:40 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:40.026Z caller=coordinator.go:119 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-28T04:12:40.227 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:40 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:40.027Z caller=coordinator.go:131 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2021-01-28T04:12:40.227 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:40 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:40.032Z caller=main.go:497 msg=Listening address=:9093 2021-01-28T04:12:40.316 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:39 smithi134 bash[24619]: t=2021-01-28T04:12:39+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2021-01-28T04:12:40.316 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2021-01-28T04:12:40.316 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2021-01-28T04:12:40.317 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2021-01-28T04:12:40.568 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2021-01-28T04:12:40.568 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2021-01-28T04:12:40.844 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2021-01-28T04:12:40.845 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2021-01-28T04:12:41.138 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2021-01-28T04:12:41.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:40 smithi134 bash[24619]: t=2021-01-28T04:12:40+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2021-01-28T04:12:41.638 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:12:41 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:12:41.639 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:41 smithi134 bash[24619]: t=2021-01-28T04:12:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2021-01-28T04:12:41.728 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:12:41 smithi150 bash[10146]: debug 2021-01-28T04:12:41.417+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:12:41.764 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2021-01-28T04:12:42.046 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:41 smithi134 bash[24619]: t=2021-01-28T04:12:41+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2021-01-28T04:12:42.046 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:41 smithi134 bash[24619]: t=2021-01-28T04:12:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2021-01-28T04:12:42.046 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:41 smithi134 bash[24619]: t=2021-01-28T04:12:41+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2021-01-28T04:12:42.047 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:41 smithi134 bash[9858]: cluster 2021-01-28T04:12:40.902888+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:42.047 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:41 smithi134 bash[9858]: audit 2021-01-28T04:12:41.760895+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.150:0/1932268994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-28T04:12:42.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:41 smithi150 bash[13629]: cluster 2021-01-28T04:12:40.902888+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:42.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:41 smithi150 bash[13629]: audit 2021-01-28T04:12:41.760895+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.150:0/1932268994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-28T04:12:42.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:41 smithi150 bash[9867]: cluster 2021-01-28T04:12:40.902888+0000 mgr.y (mgr.14138) 370 : cluster [DBG] pgmap v272: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:42.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:41 smithi150 bash[9867]: audit 2021-01-28T04:12:41.760895+0000 mon.c (mon.1) 20 : audit [DBG] from='client.? 172.21.15.150:0/1932268994' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.log", "var": "pg_num"}]: dispatch 2021-01-28T04:12:42.230 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:41 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:41.984Z caller=cluster.go:648 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000148379s 2021-01-28T04:12:42.388 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:42 smithi134 bash[24619]: t=2021-01-28T04:12:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2021-01-28T04:12:42.541 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd pool get zone.rgw.control pg_num 2021-01-28T04:12:42.697 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:42.872 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:42 smithi134 bash[24619]: t=2021-01-28T04:12:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2021-01-28T04:12:42.873 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:42 smithi134 bash[24619]: t=2021-01-28T04:12:42+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2021-01-28T04:12:43.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:43 smithi134 bash[9858]: audit 2021-01-28T04:12:41.421008+0000 mgr.y (mgr.14138) 371 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:43.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:43 smithi134 bash[24619]: t=2021-01-28T04:12:42+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2021-01-28T04:12:43.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:42 smithi150 bash[9867]: audit 2021-01-28T04:12:41.421008+0000 mgr.y (mgr.14138) 371 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:43.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:42 smithi150 bash[13629]: audit 2021-01-28T04:12:41.421008+0000 mgr.y (mgr.14138) 371 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:43.750 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:43 smithi134 bash[24619]: t=2021-01-28T04:12:43+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2021-01-28T04:12:43.750 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:43 smithi134 bash[24619]: t=2021-01-28T04:12:43+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2021-01-28T04:12:44.119 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:43 smithi134 bash[24619]: t=2021-01-28T04:12:43+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2021-01-28T04:12:44.119 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:43 smithi134 bash[24619]: t=2021-01-28T04:12:43+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2021-01-28T04:12:44.120 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:43 smithi134 bash[24619]: t=2021-01-28T04:12:43+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2021-01-28T04:12:44.120 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:43 smithi134 bash[9858]: cluster 2021-01-28T04:12:42.903859+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:44.140 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:43 smithi150 bash[9867]: cluster 2021-01-28T04:12:42.903859+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:44.141 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:43 smithi150 bash[13629]: cluster 2021-01-28T04:12:42.903859+0000 mgr.y (mgr.14138) 372 : cluster [DBG] pgmap v273: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:44.388 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:44 smithi134 bash[24619]: t=2021-01-28T04:12:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2021-01-28T04:12:44.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:44 smithi134 bash[24619]: t=2021-01-28T04:12:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2021-01-28T04:12:44.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:44 smithi134 bash[24619]: t=2021-01-28T04:12:44+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2021-01-28T04:12:44.889 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:44 smithi134 bash[24619]: t=2021-01-28T04:12:44+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2021-01-28T04:12:44.890 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:44 smithi134 bash[24619]: t=2021-01-28T04:12:44+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2021-01-28T04:12:45.304 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[24619]: t=2021-01-28T04:12:45+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2021-01-28T04:12:45.565 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[24619]: t=2021-01-28T04:12:45+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2021-01-28T04:12:45.565 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[24619]: t=2021-01-28T04:12:45+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2021-01-28T04:12:45.566 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[24619]: t=2021-01-28T04:12:45+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2021-01-28T04:12:45.894 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[24619]: t=2021-01-28T04:12:45+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2021-01-28T04:12:45.894 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[24619]: t=2021-01-28T04:12:45+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2021-01-28T04:12:45.894 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 systemd[1]: Stopping Ceph prometheus.a for d0bb049a-611d-11eb-8f9e-001a4aab830c... 2021-01-28T04:12:45.894 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=warn ts=2021-01-28T04:12:45.730Z caller=main.go:524 msg="Received SIGTERM, exiting gracefully..." 2021-01-28T04:12:45.895 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.730Z caller=main.go:547 msg="Stopping scrape discovery manager..." 2021-01-28T04:12:45.895 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=main.go:561 msg="Stopping notify discovery manager..." 2021-01-28T04:12:45.895 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=main.go:583 msg="Stopping scrape manager..." 2021-01-28T04:12:45.895 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=main.go:543 msg="Scrape discovery manager stopped" 2021-01-28T04:12:45.895 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=manager.go:882 component="rule manager" msg="Stopping rule manager..." 2021-01-28T04:12:45.896 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=main.go:557 msg="Notify discovery manager stopped" 2021-01-28T04:12:45.896 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=manager.go:892 component="rule manager" msg="Rule manager stopped" 2021-01-28T04:12:45.896 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=main.go:577 msg="Scrape manager stopped" 2021-01-28T04:12:45.896 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=notifier.go:601 component=notifier msg="Stopping notification manager..." 2021-01-28T04:12:45.896 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=main.go:749 msg="Notifier manager stopped" 2021-01-28T04:12:45.897 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[23256]: level=info ts=2021-01-28T04:12:45.731Z caller=main.go:761 msg="See you next time!" 2021-01-28T04:12:46.127 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2021-01-28T04:12:46.186 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:45 smithi150 bash[9867]: cluster 2021-01-28T04:12:44.905273+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:46.186 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:45 smithi150 bash[13629]: cluster 2021-01-28T04:12:44.905273+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:46.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[9858]: cluster 2021-01-28T04:12:44.905273+0000 mgr.y (mgr.14138) 373 : cluster [DBG] pgmap v274: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:46.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:45 smithi134 bash[24619]: t=2021-01-28T04:12:45+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2021-01-28T04:12:46.389 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:46 smithi134 bash[24619]: t=2021-01-28T04:12:46+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2021-01-28T04:12:46.888 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:46 smithi134 bash[24619]: t=2021-01-28T04:12:46+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2021-01-28T04:12:46.919 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd pool get zone.rgw.meta pg_num 2021-01-28T04:12:47.086 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:47.191 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:46 smithi134 bash[24619]: t=2021-01-28T04:12:46+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2021-01-28T04:12:47.191 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[24619]: t=2021-01-28T04:12:47+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2021-01-28T04:12:47.191 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[24619]: t=2021-01-28T04:12:47+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2021-01-28T04:12:47.192 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:46 smithi134 bash[9858]: audit 2021-01-28T04:12:46.124181+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.15.150:0/1668205706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-28T04:12:47.192 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:47 smithi134 docker[25218]: ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c-prometheus.a 2021-01-28T04:12:47.192 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:47 smithi134 systemd[1]: ceph-d0bb049a-611d-11eb-8f9e-001a4aab830c@prometheus.a.service: Succeeded. 2021-01-28T04:12:47.193 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:47 smithi134 systemd[1]: Stopped Ceph prometheus.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:12:47.193 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:47 smithi134 systemd[1]: Started Ceph prometheus.a for d0bb049a-611d-11eb-8f9e-001a4aab830c. 2021-01-28T04:12:47.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:46 smithi150 bash[13629]: audit 2021-01-28T04:12:46.124181+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.15.150:0/1668205706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-28T04:12:47.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:46 smithi150 bash[9867]: audit 2021-01-28T04:12:46.124181+0000 mon.a (mon.0) 629 : audit [DBG] from='client.? 172.21.15.150:0/1668205706' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.control", "var": "pg_num"}]: dispatch 2021-01-28T04:12:47.452 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[24619]: t=2021-01-28T04:12:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2021-01-28T04:12:47.638 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[24619]: t=2021-01-28T04:12:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2021-01-28T04:12:48.138 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[24619]: t=2021-01-28T04:12:47+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2021-01-28T04:12:48.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:48 smithi134 bash[24619]: t=2021-01-28T04:12:48+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2021-01-28T04:12:48.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: cluster 2021-01-28T04:12:46.905959+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:48.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.147207+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.151413+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T04:12:48.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.151837+0000 mgr.y (mgr.14138) 375 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T04:12:48.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.153068+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi150:9093"}]: dispatch 2021-01-28T04:12:48.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.153415+0000 mgr.y (mgr.14138) 376 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi150:9093"}]: dispatch 2021-01-28T04:12:48.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.158475+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.165519+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T04:12:48.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.166176+0000 mgr.y (mgr.14138) 377 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T04:12:48.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.173584+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134:9095"}]: dispatch 2021-01-28T04:12:48.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.174309+0000 mgr.y (mgr.14138) 378 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134:9095"}]: dispatch 2021-01-28T04:12:48.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.181266+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.188466+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T04:12:48.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.189123+0000 mgr.y (mgr.14138) 379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T04:12:48.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.196232+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134:3000"}]: dispatch 2021-01-28T04:12:48.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.196894+0000 mgr.y (mgr.14138) 380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134:3000"}]: dispatch 2021-01-28T04:12:48.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.204294+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.209823+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:48.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:47 smithi134 bash[9858]: audit 2021-01-28T04:12:47.210473+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:48.162 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: cluster 2021-01-28T04:12:46.905959+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:48.163 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.147207+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.163 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.151413+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T04:12:48.163 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.151837+0000 mgr.y (mgr.14138) 375 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T04:12:48.163 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.153068+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi150:9093"}]: dispatch 2021-01-28T04:12:48.164 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.153415+0000 mgr.y (mgr.14138) 376 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi150:9093"}]: dispatch 2021-01-28T04:12:48.164 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.158475+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.164 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.165519+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T04:12:48.164 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.166176+0000 mgr.y (mgr.14138) 377 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T04:12:48.164 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.173584+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134:9095"}]: dispatch 2021-01-28T04:12:48.165 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.174309+0000 mgr.y (mgr.14138) 378 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134:9095"}]: dispatch 2021-01-28T04:12:48.165 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.181266+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.165 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.188466+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T04:12:48.165 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.189123+0000 mgr.y (mgr.14138) 379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T04:12:48.165 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.196232+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134:3000"}]: dispatch 2021-01-28T04:12:48.166 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.196894+0000 mgr.y (mgr.14138) 380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134:3000"}]: dispatch 2021-01-28T04:12:48.166 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.204294+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.166 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.209823+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:48.166 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[9867]: audit 2021-01-28T04:12:47.210473+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:48.167 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: cluster 2021-01-28T04:12:46.905959+0000 mgr.y (mgr.14138) 374 : cluster [DBG] pgmap v275: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:48.167 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.147207+0000 mon.a (mon.0) 630 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.167 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.151413+0000 mon.a (mon.0) 631 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T04:12:48.167 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.151837+0000 mgr.y (mgr.14138) 375 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2021-01-28T04:12:48.168 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.153068+0000 mon.a (mon.0) 632 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi150:9093"}]: dispatch 2021-01-28T04:12:48.168 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.153415+0000 mgr.y (mgr.14138) 376 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi150:9093"}]: dispatch 2021-01-28T04:12:48.168 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.158475+0000 mon.a (mon.0) 633 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.168 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.165519+0000 mon.a (mon.0) 634 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T04:12:48.168 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.166176+0000 mgr.y (mgr.14138) 377 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2021-01-28T04:12:48.169 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.173584+0000 mon.a (mon.0) 635 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134:9095"}]: dispatch 2021-01-28T04:12:48.169 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.174309+0000 mgr.y (mgr.14138) 378 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134:9095"}]: dispatch 2021-01-28T04:12:48.169 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.181266+0000 mon.a (mon.0) 636 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.170 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.188466+0000 mon.a (mon.0) 637 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T04:12:48.170 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.189123+0000 mgr.y (mgr.14138) 379 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2021-01-28T04:12:48.170 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.196232+0000 mon.a (mon.0) 638 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134:3000"}]: dispatch 2021-01-28T04:12:48.170 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.196894+0000 mgr.y (mgr.14138) 380 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi134:3000"}]: dispatch 2021-01-28T04:12:48.171 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.204294+0000 mon.a (mon.0) 639 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:48.171 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.209823+0000 mon.a (mon.0) 640 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:48.171 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:47 smithi150 bash[13629]: audit 2021-01-28T04:12:47.210473+0000 mon.a (mon.0) 641 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "container_image"}]: dispatch 2021-01-28T04:12:48.803 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:48 smithi134 bash[24619]: t=2021-01-28T04:12:48+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2021-01-28T04:12:49.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:48 smithi134 bash[9858]: cluster 2021-01-28T04:12:48.907454+0000 mgr.y (mgr.14138) 381 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:49.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:48 smithi134 bash[24619]: t=2021-01-28T04:12:48+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2021-01-28T04:12:49.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2021-01-28T04:12:49.459 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2021-01-28T04:12:49.459 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2021-01-28T04:12:49.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:48 smithi150 bash[13629]: cluster 2021-01-28T04:12:48.907454+0000 mgr.y (mgr.14138) 381 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:49.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:48 smithi150 bash[9867]: cluster 2021-01-28T04:12:48.907454+0000 mgr.y (mgr.14138) 381 : cluster [DBG] pgmap v276: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:49.719 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2021-01-28T04:12:49.720 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2021-01-28T04:12:49.720 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2021-01-28T04:12:49.720 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.606Z caller=main.go:302 msg="No time or size retention was set so using the default time retention" duration=15d 2021-01-28T04:12:49.720 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.606Z caller=main.go:337 msg="Starting Prometheus" version="(version=2.18.1, branch=HEAD, revision=ecee9c8abfd118f139014cb1b174b08db3f342cf)" 2021-01-28T04:12:49.721 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.606Z caller=main.go:338 build_context="(go=go1.14.2, user=root@2117a9e64a7e, date=20200507-16:51:47)" 2021-01-28T04:12:49.721 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.606Z caller=main.go:339 host_details="(Linux 5.4.0-65-generic #73-Ubuntu SMP Mon Jan 18 17:25:17 UTC 2021 x86_64 smithi134 (none))" 2021-01-28T04:12:49.721 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.606Z caller=main.go:340 fd_limits="(soft=1048576, hard=1048576)" 2021-01-28T04:12:49.721 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.606Z caller=main.go:341 vm_limits="(soft=unlimited, hard=unlimited)" 2021-01-28T04:12:49.721 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.608Z caller=main.go:678 msg="Starting TSDB ..." 2021-01-28T04:12:49.722 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.608Z caller=web.go:523 component=web msg="Start listening for connections" address=:9095 2021-01-28T04:12:49.722 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.616Z caller=head.go:575 component=tsdb msg="Replaying WAL, this may take awhile" 2021-01-28T04:12:49.722 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.616Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2021-01-28T04:12:49.722 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.616Z caller=head.go:624 component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2021-01-28T04:12:49.723 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.616Z caller=head.go:627 component=tsdb msg="WAL replay completed" duration=646.621µs 2021-01-28T04:12:49.723 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.617Z caller=main.go:694 fs_type=XFS_SUPER_MAGIC 2021-01-28T04:12:49.723 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.617Z caller=main.go:695 msg="TSDB started" 2021-01-28T04:12:49.723 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.617Z caller=main.go:799 msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-28T04:12:49.723 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.618Z caller=main.go:827 msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml 2021-01-28T04:12:49.724 INFO:journalctl@ceph.prometheus.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[25263]: level=info ts=2021-01-28T04:12:49.618Z caller=main.go:646 msg="Server is ready to receive web requests." 2021-01-28T04:12:50.030 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2021-01-28T04:12:50.030 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2021-01-28T04:12:50.031 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2021-01-28T04:12:50.031 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:49 smithi134 bash[24619]: t=2021-01-28T04:12:49+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2021-01-28T04:12:50.031 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2021-01-28T04:12:50.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:50 smithi150 bash[9867]: audit 2021-01-28T04:12:49.088727+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:50.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:50 smithi150 bash[9867]: cephadm 2021-01-28T04:12:49.089725+0000 mgr.y (mgr.14138) 382 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:12:50.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:50 smithi150 bash[13629]: audit 2021-01-28T04:12:49.088727+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:50.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:50 smithi150 bash[13629]: cephadm 2021-01-28T04:12:49.089725+0000 mgr.y (mgr.14138) 382 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:12:50.229 INFO:journalctl@ceph.alertmanager.a.smithi150.stdout:Jan 28 04:12:49 smithi150 bash[28182]: level=info ts=2021-01-28T04:12:49.985Z caller=cluster.go:640 component=cluster msg="gossip settled; proceeding" elapsed=10.000933861s 2021-01-28T04:12:50.324 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[9858]: audit 2021-01-28T04:12:49.088727+0000 mon.a (mon.0) 642 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:50.324 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[9858]: cephadm 2021-01-28T04:12:49.089725+0000 mgr.y (mgr.14138) 382 : cephadm [INF] refreshing smithi150 facts 2021-01-28T04:12:50.324 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2021-01-28T04:12:50.324 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2021-01-28T04:12:50.325 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2021-01-28T04:12:50.347 INFO:teuthology.orchestra.run.smithi150.stdout:pg_num: 32 2021-01-28T04:12:50.617 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2021-01-28T04:12:50.618 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2021-01-28T04:12:50.618 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2021-01-28T04:12:50.618 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2021-01-28T04:12:50.618 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2021-01-28T04:12:50.877 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2021-01-28T04:12:50.878 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2021-01-28T04:12:50.878 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2021-01-28T04:12:50.878 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2021-01-28T04:12:51.099 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2021-01-28T04:12:51.102 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2021-01-28T04:12:51.102 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph mgr dump --format=json 2021-01-28T04:12:51.103 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: audit 2021-01-28T04:12:50.344140+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.150:0/1685451622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-28T04:12:51.104 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: audit 2021-01-28T04:12:50.349366+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.104 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: audit 2021-01-28T04:12:50.355727+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.104 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.356946+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:51.104 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.357679+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:51.104 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.358267+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:51.105 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.358867+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.105 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.359460+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:51.105 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.360044+0000 mgr.y (mgr.14138) 388 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.105 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.360626+0000 mgr.y (mgr.14138) 389 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.105 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: audit 2021-01-28T04:12:50.369012+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.106 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.370218+0000 mgr.y (mgr.14138) 390 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:51.106 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.371126+0000 mgr.y (mgr.14138) 391 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:51.106 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.371842+0000 mgr.y (mgr.14138) 392 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:51.106 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.372545+0000 mgr.y (mgr.14138) 393 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.106 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.373267+0000 mgr.y (mgr.14138) 394 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:51.107 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.374004+0000 mgr.y (mgr.14138) 395 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.107 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cephadm 2021-01-28T04:12:50.374742+0000 mgr.y (mgr.14138) 396 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.107 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[9867]: cluster 2021-01-28T04:12:50.908464+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:51.107 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: audit 2021-01-28T04:12:50.344140+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.150:0/1685451622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-28T04:12:51.108 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: audit 2021-01-28T04:12:50.349366+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.108 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: audit 2021-01-28T04:12:50.355727+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.108 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.356946+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:51.108 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.357679+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:51.108 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.358267+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:51.109 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.358867+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.109 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.359460+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:51.109 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.360044+0000 mgr.y (mgr.14138) 388 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.109 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.360626+0000 mgr.y (mgr.14138) 389 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.109 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: audit 2021-01-28T04:12:50.369012+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.110 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.370218+0000 mgr.y (mgr.14138) 390 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:51.110 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.371126+0000 mgr.y (mgr.14138) 391 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:51.110 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.371842+0000 mgr.y (mgr.14138) 392 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:51.111 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.372545+0000 mgr.y (mgr.14138) 393 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.111 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.373267+0000 mgr.y (mgr.14138) 394 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:51.111 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.374004+0000 mgr.y (mgr.14138) 395 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.111 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cephadm 2021-01-28T04:12:50.374742+0000 mgr.y (mgr.14138) 396 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.111 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[13629]: cluster 2021-01-28T04:12:50.908464+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:51.138 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2021-01-28T04:12:51.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2021-01-28T04:12:51.139 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:50 smithi134 bash[24619]: t=2021-01-28T04:12:50+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2021-01-28T04:12:51.140 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2021-01-28T04:12:51.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: audit 2021-01-28T04:12:50.344140+0000 mon.c (mon.1) 21 : audit [DBG] from='client.? 172.21.15.150:0/1685451622' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "zone.rgw.meta", "var": "pg_num"}]: dispatch 2021-01-28T04:12:51.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: audit 2021-01-28T04:12:50.349366+0000 mon.a (mon.0) 643 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: audit 2021-01-28T04:12:50.355727+0000 mon.a (mon.0) 644 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.356946+0000 mgr.y (mgr.14138) 383 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:51.141 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.357679+0000 mgr.y (mgr.14138) 384 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:51.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.358267+0000 mgr.y (mgr.14138) 385 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:51.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.358867+0000 mgr.y (mgr.14138) 386 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.142 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.359460+0000 mgr.y (mgr.14138) 387 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:51.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.360044+0000 mgr.y (mgr.14138) 388 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.360626+0000 mgr.y (mgr.14138) 389 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: audit 2021-01-28T04:12:50.369012+0000 mon.a (mon.0) 645 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' 2021-01-28T04:12:51.143 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.370218+0000 mgr.y (mgr.14138) 390 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='y'), HostPlacementSpec(hostname='smithi134', network='', name='x')] + new hosts [] 2021-01-28T04:12:51.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.371126+0000 mgr.y (mgr.14138) 391 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='realm.zone.a')] + new hosts [] 2021-01-28T04:12:51.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.371842+0000 mgr.y (mgr.14138) 392 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='iscsi.a')] + new hosts [] 2021-01-28T04:12:51.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.372545+0000 mgr.y (mgr.14138) 393 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.373267+0000 mgr.y (mgr.14138) 394 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a'), HostPlacementSpec(hostname='smithi134', network='', name='b')] + new hosts [] 2021-01-28T04:12:51.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.374004+0000 mgr.y (mgr.14138) 395 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi150', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cephadm 2021-01-28T04:12:50.374742+0000 mgr.y (mgr.14138) 396 : cephadm [INF] Combine hosts with existing daemons [HostPlacementSpec(hostname='smithi134', network='', name='a')] + new hosts [] 2021-01-28T04:12:51.145 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[9858]: cluster 2021-01-28T04:12:50.908464+0000 mgr.y (mgr.14138) 397 : cluster [DBG] pgmap v277: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:51.259 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:51.639 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:12:51.639 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Created default admin" logger=sqlstore user=admin 2021-01-28T04:12:51.640 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing HTTPServer" logger=server 2021-01-28T04:12:51.640 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing BackendPluginManager" logger=server 2021-01-28T04:12:51.641 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing PluginManager" logger=server 2021-01-28T04:12:51.641 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Starting plugin search" logger=plugins 2021-01-28T04:12:51.641 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Registering plugin" logger=plugins name="Pie Chart" 2021-01-28T04:12:51.642 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Registering plugin" logger=plugins name="Status Panel" 2021-01-28T04:12:51.642 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing HooksService" logger=server 2021-01-28T04:12:51.643 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing OSSLicensingService" logger=server 2021-01-28T04:12:51.643 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing InternalMetricsService" logger=server 2021-01-28T04:12:51.643 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing RemoteCache" logger=server 2021-01-28T04:12:51.644 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing RenderingService" logger=server 2021-01-28T04:12:51.644 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing AlertEngine" logger=server 2021-01-28T04:12:51.645 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing QuotaService" logger=server 2021-01-28T04:12:51.645 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing ServerLockService" logger=server 2021-01-28T04:12:51.646 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing UserAuthTokenService" logger=server 2021-01-28T04:12:51.646 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing DatasourceCacheService" logger=server 2021-01-28T04:12:51.647 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing LoginService" logger=server 2021-01-28T04:12:51.647 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing SearchService" logger=server 2021-01-28T04:12:51.647 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing TracingService" logger=server 2021-01-28T04:12:51.648 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing UsageStatsService" logger=server 2021-01-28T04:12:51.648 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing CleanUpService" logger=server 2021-01-28T04:12:51.649 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing NotificationService" logger=server 2021-01-28T04:12:51.649 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing provisioningServiceImpl" logger=server 2021-01-28T04:12:51.650 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2021-01-28T04:12:51.650 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 2021-01-28T04:12:51.650 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Backend rendering via phantomJS" logger=rendering renderer=phantomJS 2021-01-28T04:12:51.651 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=warn msg="phantomJS is deprecated and will be removed in a future release. You should consider migrating from phantomJS to grafana-image-renderer plugin. Read more at https://grafana.com/docs/grafana/latest/administration/image_rendering/" logger=rendering renderer=phantomJS 2021-01-28T04:12:51.651 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="Initializing Stream Manager" 2021-01-28T04:12:51.652 INFO:journalctl@ceph.grafana.a.smithi134.stdout:Jan 28 04:12:51 smithi134 bash[24619]: t=2021-01-28T04:12:51+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2021-01-28T04:12:51.728 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:12:51 smithi150 bash[10146]: debug 2021-01-28T04:12:51.429+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:12:52.698 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:52 smithi150 bash[13629]: audit 2021-01-28T04:12:51.430726+0000 mgr.y (mgr.14138) 398 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:52.699 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:52 smithi150 bash[9867]: audit 2021-01-28T04:12:51.430726+0000 mgr.y (mgr.14138) 398 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:52.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:52 smithi134 bash[9858]: audit 2021-01-28T04:12:51.430726+0000 mgr.y (mgr.14138) 398 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:12:53.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:53 smithi134 bash[9858]: cluster 2021-01-28T04:12:52.909477+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:53.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:53 smithi150 bash[9867]: cluster 2021-01-28T04:12:52.909477+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:53.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:53 smithi150 bash[13629]: cluster 2021-01-28T04:12:52.909477+0000 mgr.y (mgr.14138) 399 : cluster [DBG] pgmap v278: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:12:54.717 INFO:teuthology.orchestra.run.smithi150.stdout: 2021-01-28T04:12:55.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:54 smithi134 bash[9858]: audit 2021-01-28T04:12:54.704286+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.150:0/3402683441' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-28T04:12:55.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:54 smithi150 bash[9867]: audit 2021-01-28T04:12:54.704286+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.150:0/3402683441' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-28T04:12:55.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:54 smithi150 bash[13629]: audit 2021-01-28T04:12:54.704286+0000 mon.c (mon.1) 22 : audit [DBG] from='client.? 172.21.15.150:0/3402683441' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2021-01-28T04:12:55.554 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":15,"active_gid":14138,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6800","nonce":2040443655},{"type":"v1","addr":"172.21.15.150:6801","nonce":2040443655}]},"active_addr":"172.21.15.150:6801/2040443655","active_change":"2021-01-28T04:05:20.701166+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":24115,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.7.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"haproxy","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://smithi150.front.sepia.ceph.com:8443/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":3,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3793120716}]},{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":3326684142}]},{"addrvec":[{"type":"v2","addr":"172.21.15.150:0","nonce":528289179}]}]}} 2021-01-28T04:12:55.562 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2021-01-28T04:12:55.562 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2021-01-28T04:12:55.563 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd dump --format=json 2021-01-28T04:12:55.724 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:12:55.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:55 smithi150 bash[9867]: cluster 2021-01-28T04:12:54.910931+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:55.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:55 smithi150 bash[13629]: cluster 2021-01-28T04:12:54.910931+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:56.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:55 smithi134 bash[9858]: cluster 2021-01-28T04:12:54.910931+0000 mgr.y (mgr.14138) 400 : cluster [DBG] pgmap v279: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:57.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:57 smithi134 bash[9858]: cluster 2021-01-28T04:12:56.911459+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:57.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:57 smithi150 bash[9867]: cluster 2021-01-28T04:12:56.911459+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:57.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:57 smithi150 bash[13629]: cluster 2021-01-28T04:12:56.911459+0000 mgr.y (mgr.14138) 401 : cluster [DBG] pgmap v280: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:12:59.200 INFO:teuthology.orchestra.run.smithi150.stdout: 2021-01-28T04:12:59.200 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":62,"fsid":"d0bb049a-611d-11eb-8f9e-001a4aab830c","created":"2021-01-28T04:04:23.619965+0000","modified":"2021-01-28T04:12:21.959084+0000","last_up_change":"2021-01-28T04:10:58.320027+0000","last_in_change":"2021-01-28T04:10:58.320027+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-28T04:06:14.504783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-28T04:10:53.215307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-28T04:11:13.526611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-28T04:11:14.189420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-28T04:11:16.060464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-28T04:11:19.137332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"dbd745cc-a38a-42b7-beb3-7c3d2fcb148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6803","nonce":2923371016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6805","nonce":2923371016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6809","nonce":2923371016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6807","nonce":2923371016}]},"public_addr":"172.21.15.150:6803/2923371016","cluster_addr":"172.21.15.150:6805/2923371016","heartbeat_back_addr":"172.21.15.150:6809/2923371016","heartbeat_front_addr":"172.21.15.150:6807/2923371016","state":["exists","up"]},{"osd":1,"uuid":"9d3c3014-f0c7-4677-aaec-847874e216d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6811","nonce":2659937724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6813","nonce":2659937724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6817","nonce":2659937724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6815","nonce":2659937724}]},"public_addr":"172.21.15.150:6811/2659937724","cluster_addr":"172.21.15.150:6813/2659937724","heartbeat_back_addr":"172.21.15.150:6817/2659937724","heartbeat_front_addr":"172.21.15.150:6815/2659937724","state":["exists","up"]},{"osd":2,"uuid":"8ad36a92-9bcf-44fa-8132-698ca0c8f0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6819","nonce":1301223535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6821","nonce":1301223535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6825","nonce":1301223535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6823","nonce":1301223535}]},"public_addr":"172.21.15.150:6819/1301223535","cluster_addr":"172.21.15.150:6821/1301223535","heartbeat_back_addr":"172.21.15.150:6825/1301223535","heartbeat_front_addr":"172.21.15.150:6823/1301223535","state":["exists","up"]},{"osd":3,"uuid":"dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6827","nonce":3623645746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6829","nonce":3623645746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6833","nonce":3623645746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6831","nonce":3623645746}]},"public_addr":"172.21.15.150:6827/3623645746","cluster_addr":"172.21.15.150:6829/3623645746","heartbeat_back_addr":"172.21.15.150:6833/3623645746","heartbeat_front_addr":"172.21.15.150:6831/3623645746","state":["exists","up"]},{"osd":4,"uuid":"6435dc9d-5222-464a-af64-6c0dad1c65ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6801","nonce":2281694848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6803","nonce":2281694848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6807","nonce":2281694848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6805","nonce":2281694848}]},"public_addr":"172.21.15.134:6801/2281694848","cluster_addr":"172.21.15.134:6803/2281694848","heartbeat_back_addr":"172.21.15.134:6807/2281694848","heartbeat_front_addr":"172.21.15.134:6805/2281694848","state":["exists","up"]},{"osd":5,"uuid":"d31b1648-1ba1-4895-b27f-9182737d7b30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6809","nonce":2513989983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6811","nonce":2513989983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6815","nonce":2513989983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6813","nonce":2513989983}]},"public_addr":"172.21.15.134:6809/2513989983","cluster_addr":"172.21.15.134:6811/2513989983","heartbeat_back_addr":"172.21.15.134:6815/2513989983","heartbeat_front_addr":"172.21.15.134:6813/2513989983","state":["exists","up"]},{"osd":6,"uuid":"ba50ffef-fcbd-4944-8e0a-bf1c085192b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6817","nonce":1369484950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6819","nonce":1369484950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6823","nonce":1369484950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6821","nonce":1369484950}]},"public_addr":"172.21.15.134:6817/1369484950","cluster_addr":"172.21.15.134:6819/1369484950","heartbeat_back_addr":"172.21.15.134:6823/1369484950","heartbeat_front_addr":"172.21.15.134:6821/1369484950","state":["exists","up"]},{"osd":7,"uuid":"6817eafa-ca23-4efe-a5fa-b83d5c6f387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6825","nonce":1198397315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6827","nonce":1198397315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6831","nonce":1198397315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6829","nonce":1198397315}]},"public_addr":"172.21.15.134:6825/1198397315","cluster_addr":"172.21.15.134:6827/1198397315","heartbeat_back_addr":"172.21.15.134:6831/1198397315","heartbeat_front_addr":"172.21.15.134:6829/1198397315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:07:34.961688+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:08:04.329930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:08:34.491913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:01.256035+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:27.576021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:56.353445+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:10:25.746147+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:10:56.708110+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":7,"to":4}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/317046192":"2021-01-29T04:05:20.700594+0000","172.21.15.150:0/3174208176":"2021-01-29T04:05:20.700594+0000","172.21.15.150:6800/317046192":"2021-01-29T04:05:20.700594+0000","172.21.15.150:0/3728750765":"2021-01-29T04:05:20.700594+0000","172.21.15.150:6800/2805633800":"2021-01-29T04:04:58.368207+0000","172.21.15.150:6801/2805633800":"2021-01-29T04:04:58.368207+0000","172.21.15.150:0/1702946609":"2021-01-29T04:04:58.368207+0000","172.21.15.150:0/1046813580":"2021-01-29T04:04:58.368207+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-28T04:13:00.004 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2021-01-28T04:13:00.005 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd dump --format=json 2021-01-28T04:13:00.158 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:00.232 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:59 smithi150 bash[13629]: cluster 2021-01-28T04:12:58.912441+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:00.233 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:12:59 smithi150 bash[13629]: audit 2021-01-28T04:12:59.195054+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.150:0/834498241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:13:00.234 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:59 smithi150 bash[9867]: cluster 2021-01-28T04:12:58.912441+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:00.234 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:12:59 smithi150 bash[9867]: audit 2021-01-28T04:12:59.195054+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.150:0/834498241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:13:00.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:59 smithi134 bash[9858]: cluster 2021-01-28T04:12:58.912441+0000 mgr.y (mgr.14138) 402 : cluster [DBG] pgmap v281: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:00.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:12:59 smithi134 bash[9858]: audit 2021-01-28T04:12:59.195054+0000 mon.c (mon.1) 23 : audit [DBG] from='client.? 172.21.15.150:0/834498241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:13:01.728 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:13:01 smithi150 bash[10146]: debug 2021-01-28T04:13:01.437+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:13:01.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:13:01 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:13:02.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:01 smithi134 bash[9858]: cluster 2021-01-28T04:13:00.913309+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:02.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:01 smithi150 bash[13629]: cluster 2021-01-28T04:13:00.913309+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:02.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:01 smithi150 bash[9867]: cluster 2021-01-28T04:13:00.913309+0000 mgr.y (mgr.14138) 403 : cluster [DBG] pgmap v282: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:03.246 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:02 smithi150 bash[9867]: audit 2021-01-28T04:13:01.439607+0000 mgr.y (mgr.14138) 404 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:03.246 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:02 smithi150 bash[13629]: audit 2021-01-28T04:13:01.439607+0000 mgr.y (mgr.14138) 404 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:02 smithi134 bash[9858]: audit 2021-01-28T04:13:01.439607+0000 mgr.y (mgr.14138) 404 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:03.554 INFO:teuthology.orchestra.run.smithi150.stdout: 2021-01-28T04:13:03.554 INFO:teuthology.orchestra.run.smithi150.stdout:{"epoch":62,"fsid":"d0bb049a-611d-11eb-8f9e-001a4aab830c","created":"2021-01-28T04:04:23.619965+0000","modified":"2021-01-28T04:12:21.959084+0000","last_up_change":"2021-01-28T04:10:58.320027+0000","last_in_change":"2021-01-28T04:10:58.320027+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-01-28T04:06:14.504783+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":".rgw.root","create_time":"2021-01-28T04:10:53.215307+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":3,"pool_name":"iscsi","create_time":"2021-01-28T04:11:13.526611+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":3,"pg_placement_num":3,"pg_placement_num_target":3,"pg_num_target":3,"pg_num_pending":3,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":4,"pool_name":"zone.rgw.log","create_time":"2021-01-28T04:11:14.189420+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"54","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":5,"pool_name":"zone.rgw.control","create_time":"2021-01-28T04:11:16.060464+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"56","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":6,"pool_name":"zone.rgw.meta","create_time":"2021-01-28T04:11:19.137332+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"60","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":8},"application_metadata":{"rgw":{}}}],"osds":[{"osd":0,"uuid":"dbd745cc-a38a-42b7-beb3-7c3d2fcb148e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":10,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6802","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6803","nonce":2923371016}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6804","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6805","nonce":2923371016}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6808","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6809","nonce":2923371016}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6806","nonce":2923371016},{"type":"v1","addr":"172.21.15.150:6807","nonce":2923371016}]},"public_addr":"172.21.15.150:6803/2923371016","cluster_addr":"172.21.15.150:6805/2923371016","heartbeat_back_addr":"172.21.15.150:6809/2923371016","heartbeat_front_addr":"172.21.15.150:6807/2923371016","state":["exists","up"]},{"osd":1,"uuid":"9d3c3014-f0c7-4677-aaec-847874e216d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":16,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6810","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6811","nonce":2659937724}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6812","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6813","nonce":2659937724}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6816","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6817","nonce":2659937724}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6814","nonce":2659937724},{"type":"v1","addr":"172.21.15.150:6815","nonce":2659937724}]},"public_addr":"172.21.15.150:6811/2659937724","cluster_addr":"172.21.15.150:6813/2659937724","heartbeat_back_addr":"172.21.15.150:6817/2659937724","heartbeat_front_addr":"172.21.15.150:6815/2659937724","state":["exists","up"]},{"osd":2,"uuid":"8ad36a92-9bcf-44fa-8132-698ca0c8f0e7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":21,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6818","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6819","nonce":1301223535}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6820","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6821","nonce":1301223535}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6824","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6825","nonce":1301223535}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6822","nonce":1301223535},{"type":"v1","addr":"172.21.15.150:6823","nonce":1301223535}]},"public_addr":"172.21.15.150:6819/1301223535","cluster_addr":"172.21.15.150:6821/1301223535","heartbeat_back_addr":"172.21.15.150:6825/1301223535","heartbeat_front_addr":"172.21.15.150:6823/1301223535","state":["exists","up"]},{"osd":3,"uuid":"dafa81e8-f95d-4b5d-b86d-a3b5dd5f86b7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6826","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6827","nonce":3623645746}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6828","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6829","nonce":3623645746}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6832","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6833","nonce":3623645746}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.150:6830","nonce":3623645746},{"type":"v1","addr":"172.21.15.150:6831","nonce":3623645746}]},"public_addr":"172.21.15.150:6827/3623645746","cluster_addr":"172.21.15.150:6829/3623645746","heartbeat_back_addr":"172.21.15.150:6833/3623645746","heartbeat_front_addr":"172.21.15.150:6831/3623645746","state":["exists","up"]},{"osd":4,"uuid":"6435dc9d-5222-464a-af64-6c0dad1c65ba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6801","nonce":2281694848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6803","nonce":2281694848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6807","nonce":2281694848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":2281694848},{"type":"v1","addr":"172.21.15.134:6805","nonce":2281694848}]},"public_addr":"172.21.15.134:6801/2281694848","cluster_addr":"172.21.15.134:6803/2281694848","heartbeat_back_addr":"172.21.15.134:6807/2281694848","heartbeat_front_addr":"172.21.15.134:6805/2281694848","state":["exists","up"]},{"osd":5,"uuid":"d31b1648-1ba1-4895-b27f-9182737d7b30","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6809","nonce":2513989983}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6811","nonce":2513989983}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6815","nonce":2513989983}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":2513989983},{"type":"v1","addr":"172.21.15.134:6813","nonce":2513989983}]},"public_addr":"172.21.15.134:6809/2513989983","cluster_addr":"172.21.15.134:6811/2513989983","heartbeat_back_addr":"172.21.15.134:6815/2513989983","heartbeat_front_addr":"172.21.15.134:6813/2513989983","state":["exists","up"]},{"osd":6,"uuid":"ba50ffef-fcbd-4944-8e0a-bf1c085192b4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":41,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6817","nonce":1369484950}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6819","nonce":1369484950}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6823","nonce":1369484950}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":1369484950},{"type":"v1","addr":"172.21.15.134:6821","nonce":1369484950}]},"public_addr":"172.21.15.134:6817/1369484950","cluster_addr":"172.21.15.134:6819/1369484950","heartbeat_back_addr":"172.21.15.134:6823/1369484950","heartbeat_front_addr":"172.21.15.134:6821/1369484950","state":["exists","up"]},{"osd":7,"uuid":"6817eafa-ca23-4efe-a5fa-b83d5c6f387a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6825","nonce":1198397315}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6827","nonce":1198397315}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6831","nonce":1198397315}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":1198397315},{"type":"v1","addr":"172.21.15.134:6829","nonce":1198397315}]},"public_addr":"172.21.15.134:6825/1198397315","cluster_addr":"172.21.15.134:6827/1198397315","heartbeat_back_addr":"172.21.15.134:6831/1198397315","heartbeat_front_addr":"172.21.15.134:6829/1198397315","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:07:34.961688+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:08:04.329930+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:08:34.491913+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:01.256035+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:27.576021+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:09:56.353445+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:10:25.746147+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-01-28T04:10:56.708110+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.e","mappings":[{"from":7,"to":4}]},{"pgid":"4.7","mappings":[{"from":1,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":5}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.150:6801/317046192":"2021-01-29T04:05:20.700594+0000","172.21.15.150:0/3174208176":"2021-01-29T04:05:20.700594+0000","172.21.15.150:6800/317046192":"2021-01-29T04:05:20.700594+0000","172.21.15.150:0/3728750765":"2021-01-29T04:05:20.700594+0000","172.21.15.150:6800/2805633800":"2021-01-29T04:04:58.368207+0000","172.21.15.150:6801/2805633800":"2021-01-29T04:04:58.368207+0000","172.21.15.150:0/1702946609":"2021-01-29T04:04:58.368207+0000","172.21.15.150:0/1046813580":"2021-01-29T04:04:58.368207+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2021-01-28T04:13:04.340 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:03 smithi150 bash[9867]: cluster 2021-01-28T04:13:02.914327+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:04.340 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:03 smithi150 bash[9867]: audit 2021-01-28T04:13:03.549144+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.150:0/2396705247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:13:04.340 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:03 smithi150 bash[13629]: cluster 2021-01-28T04:13:02.914327+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:04.341 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:03 smithi150 bash[13629]: audit 2021-01-28T04:13:03.549144+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.150:0/2396705247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:13:04.342 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph tell osd.0 flush_pg_stats 2021-01-28T04:13:04.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:03 smithi134 bash[9858]: cluster 2021-01-28T04:13:02.914327+0000 mgr.y (mgr.14138) 405 : cluster [DBG] pgmap v283: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:04.391 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:03 smithi134 bash[9858]: audit 2021-01-28T04:13:03.549144+0000 mon.c (mon.1) 24 : audit [DBG] from='client.? 172.21.15.150:0/2396705247' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:13:04.494 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:05.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:05 smithi134 bash[9858]: cluster 2021-01-28T04:13:04.915747+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:05.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:05 smithi150 bash[9867]: cluster 2021-01-28T04:13:04.915747+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:05.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:05 smithi150 bash[13629]: cluster 2021-01-28T04:13:04.915747+0000 mgr.y (mgr.14138) 406 : cluster [DBG] pgmap v284: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:07.720 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:07 smithi150 bash[9867]: cluster 2021-01-28T04:13:06.916459+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:07.720 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:07 smithi150 bash[13629]: cluster 2021-01-28T04:13:06.916459+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:07.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:07 smithi134 bash[9858]: cluster 2021-01-28T04:13:06.916459+0000 mgr.y (mgr.14138) 407 : cluster [DBG] pgmap v285: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:08.505 INFO:teuthology.orchestra.run.smithi150.stdout:42949673028 2021-01-28T04:13:08.506 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph tell osd.1 flush_pg_stats 2021-01-28T04:13:08.661 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:10.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:09 smithi134 bash[9858]: cluster 2021-01-28T04:13:08.917970+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:10.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:09 smithi150 bash[9867]: cluster 2021-01-28T04:13:08.917970+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:10.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:09 smithi150 bash[13629]: cluster 2021-01-28T04:13:08.917970+0000 mgr.y (mgr.14138) 408 : cluster [DBG] pgmap v286: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:11.727 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:13:11 smithi150 bash[10146]: debug 2021-01-28T04:13:11.449+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:13:11.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:13:11 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:13:12.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:11 smithi150 bash[9867]: cluster 2021-01-28T04:13:10.919023+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:12.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:11 smithi150 bash[13629]: cluster 2021-01-28T04:13:10.919023+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:12.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:11 smithi134 bash[9858]: cluster 2021-01-28T04:13:10.919023+0000 mgr.y (mgr.14138) 409 : cluster [DBG] pgmap v287: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:12.543 INFO:teuthology.orchestra.run.smithi150.stdout:68719476800 2021-01-28T04:13:12.543 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph tell osd.2 flush_pg_stats 2021-01-28T04:13:12.703 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:13.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:12 smithi150 bash[9867]: audit 2021-01-28T04:13:11.451095+0000 mgr.y (mgr.14138) 410 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:13.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:12 smithi150 bash[13629]: audit 2021-01-28T04:13:11.451095+0000 mgr.y (mgr.14138) 410 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:13.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:12 smithi134 bash[9858]: audit 2021-01-28T04:13:11.451095+0000 mgr.y (mgr.14138) 410 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:14.153 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:14 smithi150 bash[13629]: cluster 2021-01-28T04:13:12.920071+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:14.154 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:13 smithi150 bash[9867]: cluster 2021-01-28T04:13:12.920071+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:14.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:13 smithi134 bash[9858]: cluster 2021-01-28T04:13:12.920071+0000 mgr.y (mgr.14138) 411 : cluster [DBG] pgmap v288: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:15.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:15 smithi150 bash[9867]: cluster 2021-01-28T04:13:14.921594+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:15.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:15 smithi150 bash[13629]: cluster 2021-01-28T04:13:14.921594+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:15.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:15 smithi134 bash[9858]: cluster 2021-01-28T04:13:14.921594+0000 mgr.y (mgr.14138) 412 : cluster [DBG] pgmap v289: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:16.784 INFO:teuthology.orchestra.run.smithi150.stdout:90194313275 2021-01-28T04:13:16.785 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph tell osd.3 flush_pg_stats 2021-01-28T04:13:16.940 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:17.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:17 smithi134 bash[9858]: cluster 2021-01-28T04:13:16.922474+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:17.967 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:17 smithi150 bash[9867]: cluster 2021-01-28T04:13:16.922474+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:17.967 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:17 smithi150 bash[13629]: cluster 2021-01-28T04:13:16.922474+0000 mgr.y (mgr.14138) 413 : cluster [DBG] pgmap v290: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:20.056 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:19 smithi150 bash[9867]: cluster 2021-01-28T04:13:18.923374+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:20.056 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:19 smithi150 bash[13629]: cluster 2021-01-28T04:13:18.923374+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:20.392 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:19 smithi134 bash[9858]: cluster 2021-01-28T04:13:18.923374+0000 mgr.y (mgr.14138) 414 : cluster [DBG] pgmap v291: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:20.790 INFO:teuthology.orchestra.run.smithi150.stdout:111669149751 2021-01-28T04:13:20.791 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph tell osd.4 flush_pg_stats 2021-01-28T04:13:20.944 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:21.727 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:13:21 smithi150 bash[10146]: debug 2021-01-28T04:13:21.457+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:13:21.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:13:21 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:13:22.193 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:21 smithi150 bash[13629]: cluster 2021-01-28T04:13:20.924342+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:22.194 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:21 smithi150 bash[13629]: audit 2021-01-28T04:13:20.986149+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:13:22.194 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:21 smithi150 bash[13629]: audit 2021-01-28T04:13:20.988703+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:13:22.194 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:21 smithi150 bash[9867]: cluster 2021-01-28T04:13:20.924342+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:22.194 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:21 smithi150 bash[9867]: audit 2021-01-28T04:13:20.986149+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:13:22.195 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:21 smithi150 bash[9867]: audit 2021-01-28T04:13:20.988703+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:13:22.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:21 smithi134 bash[9858]: cluster 2021-01-28T04:13:20.924342+0000 mgr.y (mgr.14138) 415 : cluster [DBG] pgmap v292: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:22.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:21 smithi134 bash[9858]: audit 2021-01-28T04:13:20.986149+0000 mon.a (mon.0) 646 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:13:22.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:21 smithi134 bash[9858]: audit 2021-01-28T04:13:20.988703+0000 mon.a (mon.0) 647 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:13:23.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:22 smithi150 bash[9867]: audit 2021-01-28T04:13:21.462483+0000 mgr.y (mgr.14138) 416 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:23.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:22 smithi150 bash[13629]: audit 2021-01-28T04:13:21.462483+0000 mgr.y (mgr.14138) 416 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:23.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:22 smithi134 bash[9858]: audit 2021-01-28T04:13:21.462483+0000 mgr.y (mgr.14138) 416 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:24.141 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:23 smithi150 bash[9867]: cluster 2021-01-28T04:13:22.925317+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:24.141 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:23 smithi150 bash[13629]: cluster 2021-01-28T04:13:22.925317+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:24.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:23 smithi134 bash[9858]: cluster 2021-01-28T04:13:22.925317+0000 mgr.y (mgr.14138) 417 : cluster [DBG] pgmap v293: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:24.911 INFO:teuthology.orchestra.run.smithi150.stdout:133143986225 2021-01-28T04:13:24.911 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph tell osd.5 flush_pg_stats 2021-01-28T04:13:25.070 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:26.248 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:25 smithi150 bash[9867]: cluster 2021-01-28T04:13:24.926785+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:26.249 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:25 smithi150 bash[13629]: cluster 2021-01-28T04:13:24.926785+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:26.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:25 smithi134 bash[9858]: cluster 2021-01-28T04:13:24.926785+0000 mgr.y (mgr.14138) 418 : cluster [DBG] pgmap v294: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:27.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:27 smithi134 bash[9858]: cluster 2021-01-28T04:13:26.927531+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:27.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:27 smithi150 bash[9867]: cluster 2021-01-28T04:13:26.927531+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:27.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:27 smithi150 bash[13629]: cluster 2021-01-28T04:13:26.927531+0000 mgr.y (mgr.14138) 419 : cluster [DBG] pgmap v295: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:29.169 INFO:teuthology.orchestra.run.smithi150.stdout:154618822701 2021-01-28T04:13:29.170 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph tell osd.6 flush_pg_stats 2021-01-28T04:13:29.320 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:30.379 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:29 smithi150 bash[9867]: cluster 2021-01-28T04:13:28.929056+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:30.380 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:29 smithi150 bash[13629]: cluster 2021-01-28T04:13:28.929056+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:30.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:29 smithi134 bash[9858]: cluster 2021-01-28T04:13:28.929056+0000 mgr.y (mgr.14138) 420 : cluster [DBG] pgmap v296: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:31.727 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:13:31 smithi150 bash[10146]: debug 2021-01-28T04:13:31.469+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:13:31.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:13:31 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:13:32.348 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:31 smithi150 bash[13629]: cluster 2021-01-28T04:13:30.929987+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:32.348 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:31 smithi150 bash[9867]: cluster 2021-01-28T04:13:30.929987+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:32.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:31 smithi134 bash[9858]: cluster 2021-01-28T04:13:30.929987+0000 mgr.y (mgr.14138) 421 : cluster [DBG] pgmap v297: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:33.004 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:33 smithi150 bash[9867]: audit 2021-01-28T04:13:31.473834+0000 mgr.y (mgr.14138) 422 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:33.333 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:33 smithi150 bash[13629]: audit 2021-01-28T04:13:31.473834+0000 mgr.y (mgr.14138) 422 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:33.334 INFO:teuthology.orchestra.run.smithi150.stdout:176093659175 2021-01-28T04:13:33.335 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph tell osd.7 flush_pg_stats 2021-01-28T04:13:33.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:33 smithi134 bash[9858]: audit 2021-01-28T04:13:31.473834+0000 mgr.y (mgr.14138) 422 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:33.482 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:34.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:34 smithi134 bash[9858]: cluster 2021-01-28T04:13:32.931025+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:34.431 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:34 smithi150 bash[9867]: cluster 2021-01-28T04:13:32.931025+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:34.431 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:34 smithi150 bash[13629]: cluster 2021-01-28T04:13:32.931025+0000 mgr.y (mgr.14138) 423 : cluster [DBG] pgmap v298: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:35.381 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:35 smithi150 bash[13629]: cluster 2021-01-28T04:13:34.932426+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:35.382 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:35 smithi150 bash[9867]: cluster 2021-01-28T04:13:34.932426+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:35.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:35 smithi134 bash[9858]: cluster 2021-01-28T04:13:34.932426+0000 mgr.y (mgr.14138) 424 : cluster [DBG] pgmap v299: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:37.348 INFO:teuthology.orchestra.run.smithi150.stdout:210453397538 2021-01-28T04:13:37.349 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.0 2021-01-28T04:13:37.498 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:37.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:37 smithi134 bash[9858]: cluster 2021-01-28T04:13:36.933400+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:37.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:37 smithi150 bash[9867]: cluster 2021-01-28T04:13:36.933400+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:37.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:37 smithi150 bash[13629]: cluster 2021-01-28T04:13:36.933400+0000 mgr.y (mgr.14138) 425 : cluster [DBG] pgmap v300: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:40.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:39 smithi134 bash[9858]: cluster 2021-01-28T04:13:38.934921+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:40.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:39 smithi150 bash[9867]: cluster 2021-01-28T04:13:38.934921+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:40.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:39 smithi150 bash[13629]: cluster 2021-01-28T04:13:38.934921+0000 mgr.y (mgr.14138) 426 : cluster [DBG] pgmap v301: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:40.921 INFO:teuthology.orchestra.run.smithi150.stdout:42949673035 2021-01-28T04:13:41.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:41 smithi150 bash[13629]: audit 2021-01-28T04:13:40.918708+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.150:0/1022990252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-28T04:13:41.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:41 smithi150 bash[9867]: audit 2021-01-28T04:13:40.918708+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.150:0/1022990252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-28T04:13:41.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:41 smithi134 bash[9858]: audit 2021-01-28T04:13:40.918708+0000 mon.a (mon.0) 648 : audit [DBG] from='client.? 172.21.15.150:0/1022990252' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2021-01-28T04:13:41.728 INFO:tasks.cephadm.ceph_manager.ceph:need seq 42949673028 got 42949673035 for osd.0 2021-01-28T04:13:41.729 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.1 2021-01-28T04:13:41.741 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:13:41 smithi150 bash[10146]: debug 2021-01-28T04:13:41.481+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:13:41.881 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:41.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:13:41 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:13:42.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:42 smithi150 bash[9867]: cluster 2021-01-28T04:13:40.936028+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:42.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:42 smithi150 bash[9867]: audit 2021-01-28T04:13:41.485173+0000 mgr.y (mgr.14138) 428 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:42.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:42 smithi150 bash[13629]: cluster 2021-01-28T04:13:40.936028+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:42.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:42 smithi150 bash[13629]: audit 2021-01-28T04:13:41.485173+0000 mgr.y (mgr.14138) 428 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:42.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:42 smithi134 bash[9858]: cluster 2021-01-28T04:13:40.936028+0000 mgr.y (mgr.14138) 427 : cluster [DBG] pgmap v302: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:42.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:42 smithi134 bash[9858]: audit 2021-01-28T04:13:41.485173+0000 mgr.y (mgr.14138) 428 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:43.271 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:43 smithi150 bash[13629]: cluster 2021-01-28T04:13:42.937098+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:43.271 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:43 smithi150 bash[9867]: cluster 2021-01-28T04:13:42.937098+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:43.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:43 smithi134 bash[9858]: cluster 2021-01-28T04:13:42.937098+0000 mgr.y (mgr.14138) 429 : cluster [DBG] pgmap v303: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:45.370 INFO:teuthology.orchestra.run.smithi150.stdout:68719476807 2021-01-28T04:13:46.185 INFO:tasks.cephadm.ceph_manager.ceph:need seq 68719476800 got 68719476807 for osd.1 2021-01-28T04:13:46.186 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.2 2021-01-28T04:13:46.337 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:46.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:46 smithi134 bash[9858]: cluster 2021-01-28T04:13:44.938406+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:46.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:46 smithi134 bash[9858]: audit 2021-01-28T04:13:45.368270+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.150:0/3873607675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-28T04:13:46.389 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:45 smithi150 bash[9867]: cluster 2021-01-28T04:13:44.938406+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:46.389 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:45 smithi150 bash[9867]: audit 2021-01-28T04:13:45.368270+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.150:0/3873607675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-28T04:13:46.390 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:46 smithi150 bash[13629]: cluster 2021-01-28T04:13:44.938406+0000 mgr.y (mgr.14138) 430 : cluster [DBG] pgmap v304: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:46.390 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:46 smithi150 bash[13629]: audit 2021-01-28T04:13:45.368270+0000 mon.a (mon.0) 649 : audit [DBG] from='client.? 172.21.15.150:0/3873607675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2021-01-28T04:13:47.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:47 smithi150 bash[13629]: cluster 2021-01-28T04:13:46.939291+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:47.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:47 smithi150 bash[9867]: cluster 2021-01-28T04:13:46.939291+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:48.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:47 smithi134 bash[9858]: cluster 2021-01-28T04:13:46.939291+0000 mgr.y (mgr.14138) 431 : cluster [DBG] pgmap v305: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:49.839 INFO:teuthology.orchestra.run.smithi150.stdout:90194313282 2021-01-28T04:13:50.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:49 smithi150 bash[13629]: cluster 2021-01-28T04:13:48.940729+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:50.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:49 smithi150 bash[13629]: audit 2021-01-28T04:13:49.837083+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.15.150:0/1524371089' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-28T04:13:50.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:50 smithi150 bash[9867]: cluster 2021-01-28T04:13:48.940729+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:50.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:50 smithi150 bash[9867]: audit 2021-01-28T04:13:49.837083+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.15.150:0/1524371089' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-28T04:13:50.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:50 smithi134 bash[9858]: cluster 2021-01-28T04:13:48.940729+0000 mgr.y (mgr.14138) 432 : cluster [DBG] pgmap v306: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:50.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:50 smithi134 bash[9858]: audit 2021-01-28T04:13:49.837083+0000 mon.a (mon.0) 650 : audit [DBG] from='client.? 172.21.15.150:0/1524371089' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2021-01-28T04:13:50.683 INFO:tasks.cephadm.ceph_manager.ceph:need seq 90194313275 got 90194313282 for osd.2 2021-01-28T04:13:50.686 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.3 2021-01-28T04:13:50.838 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:51.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:51 smithi150 bash[9867]: cluster 2021-01-28T04:13:50.941686+0000 mgr.y (mgr.14138) 433 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:51.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:51 smithi150 bash[13629]: cluster 2021-01-28T04:13:50.941686+0000 mgr.y (mgr.14138) 433 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:51.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:51 smithi134 bash[9858]: cluster 2021-01-28T04:13:50.941686+0000 mgr.y (mgr.14138) 433 : cluster [DBG] pgmap v307: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:51.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:13:51 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:13:51.945 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:13:51 smithi150 bash[10146]: debug 2021-01-28T04:13:51.485+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:13:52.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:52 smithi134 bash[9858]: audit 2021-01-28T04:13:51.488150+0000 mgr.y (mgr.14138) 434 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:52.918 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:52 smithi150 bash[9867]: audit 2021-01-28T04:13:51.488150+0000 mgr.y (mgr.14138) 434 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:52.919 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:52 smithi150 bash[13629]: audit 2021-01-28T04:13:51.488150+0000 mgr.y (mgr.14138) 434 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:13:53.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:53 smithi150 bash[9867]: cluster 2021-01-28T04:13:52.942772+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:53.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:53 smithi150 bash[13629]: cluster 2021-01-28T04:13:52.942772+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:54.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:53 smithi134 bash[9858]: cluster 2021-01-28T04:13:52.942772+0000 mgr.y (mgr.14138) 435 : cluster [DBG] pgmap v308: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:54.292 INFO:teuthology.orchestra.run.smithi150.stdout:111669149757 2021-01-28T04:13:54.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:54 smithi150 bash[9867]: audit 2021-01-28T04:13:54.290713+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.150:0/1881521834' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-28T04:13:54.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:54 smithi150 bash[13629]: audit 2021-01-28T04:13:54.290713+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.150:0/1881521834' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-28T04:13:55.098 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149751 got 111669149757 for osd.3 2021-01-28T04:13:55.101 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.4 2021-01-28T04:13:55.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:54 smithi134 bash[9858]: audit 2021-01-28T04:13:54.290713+0000 mon.c (mon.1) 25 : audit [DBG] from='client.? 172.21.15.150:0/1881521834' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2021-01-28T04:13:55.253 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:55.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:55 smithi150 bash[9867]: cluster 2021-01-28T04:13:54.944034+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:55.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:55 smithi150 bash[13629]: cluster 2021-01-28T04:13:54.944034+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:56.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:55 smithi134 bash[9858]: cluster 2021-01-28T04:13:54.944034+0000 mgr.y (mgr.14138) 436 : cluster [DBG] pgmap v309: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:57.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:57 smithi134 bash[9858]: cluster 2021-01-28T04:13:56.944889+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:57.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:57 smithi150 bash[9867]: cluster 2021-01-28T04:13:56.944889+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:57.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:57 smithi150 bash[13629]: cluster 2021-01-28T04:13:56.944889+0000 mgr.y (mgr.14138) 437 : cluster [DBG] pgmap v310: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:13:58.749 INFO:teuthology.orchestra.run.smithi150.stdout:133143986232 2021-01-28T04:13:59.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:58 smithi134 bash[9858]: audit 2021-01-28T04:13:58.747865+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.150:0/2914679892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-28T04:13:59.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:58 smithi150 bash[9867]: audit 2021-01-28T04:13:58.747865+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.150:0/2914679892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-28T04:13:59.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:58 smithi150 bash[13629]: audit 2021-01-28T04:13:58.747865+0000 mon.c (mon.1) 26 : audit [DBG] from='client.? 172.21.15.150:0/2914679892' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2021-01-28T04:13:59.579 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986225 got 133143986232 for osd.4 2021-01-28T04:13:59.581 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.5 2021-01-28T04:13:59.741 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:13:59.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:13:59 smithi150 bash[9867]: cluster 2021-01-28T04:13:58.946303+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:13:59.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:13:59 smithi150 bash[13629]: cluster 2021-01-28T04:13:58.946303+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:00.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:13:59 smithi134 bash[9858]: cluster 2021-01-28T04:13:58.946303+0000 mgr.y (mgr.14138) 438 : cluster [DBG] pgmap v311: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:01.773 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:14:01 smithi150 bash[10146]: debug 2021-01-28T04:14:01.497+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:14:01.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:14:01 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:14:02.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:02 smithi150 bash[13629]: cluster 2021-01-28T04:14:00.947100+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:02.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:02 smithi150 bash[9867]: cluster 2021-01-28T04:14:00.947100+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:02.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:02 smithi134 bash[9858]: cluster 2021-01-28T04:14:00.947100+0000 mgr.y (mgr.14138) 439 : cluster [DBG] pgmap v312: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:03.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:03 smithi150 bash[9867]: audit 2021-01-28T04:14:01.500113+0000 mgr.y (mgr.14138) 440 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:03.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:03 smithi150 bash[9867]: cluster 2021-01-28T04:14:02.947941+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:03.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:03 smithi150 bash[13629]: audit 2021-01-28T04:14:01.500113+0000 mgr.y (mgr.14138) 440 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:03.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:03 smithi150 bash[13629]: cluster 2021-01-28T04:14:02.947941+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:03.241 INFO:teuthology.orchestra.run.smithi150.stdout:154618822707 2021-01-28T04:14:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:03 smithi134 bash[9858]: audit 2021-01-28T04:14:01.500113+0000 mgr.y (mgr.14138) 440 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:03 smithi134 bash[9858]: cluster 2021-01-28T04:14:02.947941+0000 mgr.y (mgr.14138) 441 : cluster [DBG] pgmap v313: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:04.022 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822701 got 154618822707 for osd.5 2021-01-28T04:14:04.025 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.6 2021-01-28T04:14:04.177 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:14:04.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:04 smithi134 bash[9858]: audit 2021-01-28T04:14:03.240417+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.150:0/4190713565' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-28T04:14:04.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:04 smithi150 bash[9867]: audit 2021-01-28T04:14:03.240417+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.150:0/4190713565' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-28T04:14:04.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:04 smithi150 bash[13629]: audit 2021-01-28T04:14:03.240417+0000 mon.c (mon.1) 27 : audit [DBG] from='client.? 172.21.15.150:0/4190713565' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2021-01-28T04:14:05.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:05 smithi134 bash[9858]: cluster 2021-01-28T04:14:04.949205+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:05.420 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:05 smithi150 bash[9867]: cluster 2021-01-28T04:14:04.949205+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:05.421 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:05 smithi150 bash[13629]: cluster 2021-01-28T04:14:04.949205+0000 mgr.y (mgr.14138) 442 : cluster [DBG] pgmap v314: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:07.496 INFO:teuthology.orchestra.run.smithi150.stdout:176093659182 2021-01-28T04:14:07.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:07 smithi150 bash[9867]: cluster 2021-01-28T04:14:06.950068+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:07.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:07 smithi150 bash[9867]: audit 2021-01-28T04:14:07.495256+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.15.150:0/1532052527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-28T04:14:07.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:07 smithi150 bash[13629]: cluster 2021-01-28T04:14:06.950068+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:07.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:07 smithi150 bash[13629]: audit 2021-01-28T04:14:07.495256+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.15.150:0/1532052527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-28T04:14:08.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:07 smithi134 bash[9858]: cluster 2021-01-28T04:14:06.950068+0000 mgr.y (mgr.14138) 443 : cluster [DBG] pgmap v315: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:08.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:07 smithi134 bash[9858]: audit 2021-01-28T04:14:07.495256+0000 mon.a (mon.0) 651 : audit [DBG] from='client.? 172.21.15.150:0/1532052527' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2021-01-28T04:14:08.327 INFO:tasks.cephadm.ceph_manager.ceph:need seq 176093659175 got 176093659182 for osd.6 2021-01-28T04:14:08.330 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph osd last-stat-seq osd.7 2021-01-28T04:14:08.480 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:14:09.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:09 smithi134 bash[9858]: cluster 2021-01-28T04:14:08.951421+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:09.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:09 smithi150 bash[9867]: cluster 2021-01-28T04:14:08.951421+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:09.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:09 smithi150 bash[13629]: cluster 2021-01-28T04:14:08.951421+0000 mgr.y (mgr.14138) 444 : cluster [DBG] pgmap v316: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:11.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:11 smithi134 bash[9858]: cluster 2021-01-28T04:14:10.952368+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:11.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:11 smithi150 bash[9867]: cluster 2021-01-28T04:14:10.952368+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:11.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:11 smithi150 bash[13629]: cluster 2021-01-28T04:14:10.952368+0000 mgr.y (mgr.14138) 445 : cluster [DBG] pgmap v317: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:11.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:14:11 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:14:11.915 INFO:teuthology.orchestra.run.smithi150.stdout:210453397545 2021-01-28T04:14:11.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:14:11 smithi150 bash[10146]: debug 2021-01-28T04:14:11.509+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:14:12.725 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397538 got 210453397545 for osd.7 2021-01-28T04:14:12.725 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2021-01-28T04:14:12.726 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph pg dump --format=json 2021-01-28T04:14:12.877 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:14:12.925 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:12 smithi150 bash[9867]: audit 2021-01-28T04:14:11.511803+0000 mgr.y (mgr.14138) 446 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:12.925 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:12 smithi150 bash[9867]: audit 2021-01-28T04:14:11.914189+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.150:0/3654752867' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-28T04:14:12.925 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:12 smithi150 bash[13629]: audit 2021-01-28T04:14:11.511803+0000 mgr.y (mgr.14138) 446 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:12.926 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:12 smithi150 bash[13629]: audit 2021-01-28T04:14:11.914189+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.150:0/3654752867' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-28T04:14:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:12 smithi134 bash[9858]: audit 2021-01-28T04:14:11.511803+0000 mgr.y (mgr.14138) 446 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:12 smithi134 bash[9858]: audit 2021-01-28T04:14:11.914189+0000 mon.c (mon.1) 28 : audit [DBG] from='client.? 172.21.15.150:0/3654752867' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2021-01-28T04:14:13.934 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:13 smithi150 bash[9867]: cluster 2021-01-28T04:14:12.953251+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:13.934 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:13 smithi150 bash[13629]: cluster 2021-01-28T04:14:12.953251+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:14.144 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:13 smithi134 bash[9858]: cluster 2021-01-28T04:14:12.953251+0000 mgr.y (mgr.14138) 447 : cluster [DBG] pgmap v318: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:15.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:15 smithi150 bash[9867]: cluster 2021-01-28T04:14:14.954521+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:15.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:15 smithi150 bash[13629]: cluster 2021-01-28T04:14:14.954521+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:15.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:15 smithi134 bash[9858]: cluster 2021-01-28T04:14:14.954521+0000 mgr.y (mgr.14138) 448 : cluster [DBG] pgmap v319: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:16.375 INFO:teuthology.orchestra.run.smithi150.stdout: 2021-01-28T04:14:16.379 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2021-01-28T04:14:17.116 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":319,"stamp":"2021-01-28T04:14:14.953537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":1645,"num_read_kb":1113,"num_write":759,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":2286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":742,"ondisk_log_size":742,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":51964,"kb_used_data":6972,"kb_used_omap":0,"kb_used_meta":44928,"kb_avail":749909252,"statfs":{"total":767960285184,"available":767907074048,"internally_reserved":0,"allocated":7139328,"data_stored":2351838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46006272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006154"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967059+0000","last_change":"2021-01-28T04:11:20.766600+0000","last_active":"2021-01-28T04:12:20.967059+0000","last_peered":"2021-01-28T04:12:20.967059+0000","last_clean":"2021-01-28T04:12:20.967059+0000","last_became_active":"2021-01-28T04:11:20.765858+0000","last_became_peered":"2021-01-28T04:11:20.765858+0000","last_unstale":"2021-01-28T04:12:20.967059+0000","last_undegraded":"2021-01-28T04:12:20.967059+0000","last_fullsized":"2021-01-28T04:12:20.967059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982775+0000","last_change":"2021-01-28T04:11:17.639617+0000","last_active":"2021-01-28T04:12:20.982775+0000","last_peered":"2021-01-28T04:12:20.982775+0000","last_clean":"2021-01-28T04:12:20.982775+0000","last_became_active":"2021-01-28T04:11:17.639183+0000","last_became_peered":"2021-01-28T04:11:17.639183+0000","last_unstale":"2021-01-28T04:12:20.982775+0000","last_undegraded":"2021-01-28T04:12:20.982775+0000","last_fullsized":"2021-01-28T04:12:20.982775+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968713+0000","last_change":"2021-01-28T04:10:59.362859+0000","last_active":"2021-01-28T04:12:20.968713+0000","last_peered":"2021-01-28T04:12:20.968713+0000","last_clean":"2021-01-28T04:12:20.968713+0000","last_became_active":"2021-01-28T04:10:59.362335+0000","last_became_peered":"2021-01-28T04:10:59.362335+0000","last_unstale":"2021-01-28T04:12:20.968713+0000","last_undegraded":"2021-01-28T04:12:20.968713+0000","last_fullsized":"2021-01-28T04:12:20.968713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'44","reported_seq":"113","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966735+0000","last_change":"2021-01-28T04:11:15.626538+0000","last_active":"2021-01-28T04:12:20.966735+0000","last_peered":"2021-01-28T04:12:20.966735+0000","last_clean":"2021-01-28T04:12:20.966735+0000","last_became_active":"2021-01-28T04:11:15.625676+0000","last_became_peered":"2021-01-28T04:11:15.625676+0000","last_unstale":"2021-01-28T04:12:20.966735+0000","last_undegraded":"2021-01-28T04:12:20.966735+0000","last_fullsized":"2021-01-28T04:12:20.966735+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":89,"num_read_kb":66,"num_write":45,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986123+0000","last_change":"2021-01-28T04:11:20.676805+0000","last_active":"2021-01-28T04:12:20.986123+0000","last_peered":"2021-01-28T04:12:20.986123+0000","last_clean":"2021-01-28T04:12:20.986123+0000","last_became_active":"2021-01-28T04:11:20.675726+0000","last_became_peered":"2021-01-28T04:11:20.675726+0000","last_unstale":"2021-01-28T04:12:20.986123+0000","last_undegraded":"2021-01-28T04:12:20.986123+0000","last_fullsized":"2021-01-28T04:12:20.986123+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976685+0000","last_change":"2021-01-28T04:11:17.618047+0000","last_active":"2021-01-28T04:12:20.976685+0000","last_peered":"2021-01-28T04:12:20.976685+0000","last_clean":"2021-01-28T04:12:20.976685+0000","last_became_active":"2021-01-28T04:11:17.617474+0000","last_became_peered":"2021-01-28T04:11:17.617474+0000","last_unstale":"2021-01-28T04:12:20.976685+0000","last_undegraded":"2021-01-28T04:12:20.976685+0000","last_fullsized":"2021-01-28T04:12:20.976685+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.971488+0000","last_change":"2021-01-28T04:10:54.295095+0000","last_active":"2021-01-28T04:12:20.971488+0000","last_peered":"2021-01-28T04:12:20.971488+0000","last_clean":"2021-01-28T04:12:20.971488+0000","last_became_active":"2021-01-28T04:10:54.294535+0000","last_became_peered":"2021-01-28T04:10:54.294535+0000","last_unstale":"2021-01-28T04:12:20.971488+0000","last_undegraded":"2021-01-28T04:12:20.971488+0000","last_fullsized":"2021-01-28T04:12:20.971488+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"60'21","reported_seq":"60","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982105+0000","last_change":"2021-01-28T04:11:15.616744+0000","last_active":"2021-01-28T04:12:20.982105+0000","last_peered":"2021-01-28T04:12:20.982105+0000","last_clean":"2021-01-28T04:12:20.982105+0000","last_became_active":"2021-01-28T04:11:15.615747+0000","last_became_peered":"2021-01-28T04:11:15.615747+0000","last_unstale":"2021-01-28T04:12:20.982105+0000","last_undegraded":"2021-01-28T04:12:20.982105+0000","last_fullsized":"2021-01-28T04:12:20.982105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978212+0000","last_change":"2021-01-28T04:11:20.674672+0000","last_active":"2021-01-28T04:12:20.978212+0000","last_peered":"2021-01-28T04:12:20.978212+0000","last_clean":"2021-01-28T04:12:20.978212+0000","last_became_active":"2021-01-28T04:11:20.674292+0000","last_became_peered":"2021-01-28T04:11:20.674292+0000","last_unstale":"2021-01-28T04:12:20.978212+0000","last_undegraded":"2021-01-28T04:12:20.978212+0000","last_fullsized":"2021-01-28T04:12:20.978212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984009+0000","last_change":"2021-01-28T04:11:17.633230+0000","last_active":"2021-01-28T04:12:20.984009+0000","last_peered":"2021-01-28T04:12:20.984009+0000","last_clean":"2021-01-28T04:12:20.984009+0000","last_became_active":"2021-01-28T04:11:17.632495+0000","last_became_peered":"2021-01-28T04:11:17.632495+0000","last_unstale":"2021-01-28T04:12:20.984009+0000","last_undegraded":"2021-01-28T04:12:20.984009+0000","last_fullsized":"2021-01-28T04:12:20.984009+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982446+0000","last_change":"2021-01-28T04:10:59.357670+0000","last_active":"2021-01-28T04:12:20.982446+0000","last_peered":"2021-01-28T04:12:20.982446+0000","last_clean":"2021-01-28T04:12:20.982446+0000","last_became_active":"2021-01-28T04:10:59.357150+0000","last_became_peered":"2021-01-28T04:10:59.357150+0000","last_unstale":"2021-01-28T04:12:20.982446+0000","last_undegraded":"2021-01-28T04:12:20.982446+0000","last_fullsized":"2021-01-28T04:12:20.982446+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"60'12","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987453+0000","last_change":"2021-01-28T04:11:15.614366+0000","last_active":"2021-01-28T04:12:20.987453+0000","last_peered":"2021-01-28T04:12:20.987453+0000","last_clean":"2021-01-28T04:12:20.987453+0000","last_became_active":"2021-01-28T04:11:15.613914+0000","last_became_peered":"2021-01-28T04:11:15.613914+0000","last_unstale":"2021-01-28T04:12:20.987453+0000","last_undegraded":"2021-01-28T04:12:20.987453+0000","last_fullsized":"2021-01-28T04:12:20.987453+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":13,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967067+0000","last_change":"2021-01-28T04:11:20.677013+0000","last_active":"2021-01-28T04:12:20.967067+0000","last_peered":"2021-01-28T04:12:20.967067+0000","last_clean":"2021-01-28T04:12:20.967067+0000","last_became_active":"2021-01-28T04:11:20.676371+0000","last_became_peered":"2021-01-28T04:11:20.676371+0000","last_unstale":"2021-01-28T04:12:20.967067+0000","last_undegraded":"2021-01-28T04:12:20.967067+0000","last_fullsized":"2021-01-28T04:12:20.967067+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.979285+0000","last_change":"2021-01-28T04:11:17.624098+0000","last_active":"2021-01-28T04:12:20.979285+0000","last_peered":"2021-01-28T04:12:20.979285+0000","last_clean":"2021-01-28T04:12:20.979285+0000","last_became_active":"2021-01-28T04:11:17.623603+0000","last_became_peered":"2021-01-28T04:11:17.623603+0000","last_unstale":"2021-01-28T04:12:20.979285+0000","last_undegraded":"2021-01-28T04:12:20.979285+0000","last_fullsized":"2021-01-28T04:12:20.979285+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.983704+0000","last_change":"2021-01-28T04:10:59.358847+0000","last_active":"2021-01-28T04:12:20.983704+0000","last_peered":"2021-01-28T04:12:20.983704+0000","last_clean":"2021-01-28T04:12:20.983704+0000","last_became_active":"2021-01-28T04:10:59.358007+0000","last_became_peered":"2021-01-28T04:10:59.358007+0000","last_unstale":"2021-01-28T04:12:20.983704+0000","last_undegraded":"2021-01-28T04:12:20.983704+0000","last_fullsized":"2021-01-28T04:12:20.983704+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"60'25","reported_seq":"71","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986367+0000","last_change":"2021-01-28T04:11:15.618015+0000","last_active":"2021-01-28T04:12:20.986367+0000","last_peered":"2021-01-28T04:12:20.986367+0000","last_clean":"2021-01-28T04:12:20.986367+0000","last_became_active":"2021-01-28T04:11:15.617664+0000","last_became_peered":"2021-01-28T04:11:15.617664+0000","last_unstale":"2021-01-28T04:12:20.986367+0000","last_undegraded":"2021-01-28T04:12:20.986367+0000","last_fullsized":"2021-01-28T04:12:20.986367+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.970732+0000","last_change":"2021-01-28T04:11:20.762627+0000","last_active":"2021-01-28T04:12:20.970732+0000","last_peered":"2021-01-28T04:12:20.970732+0000","last_clean":"2021-01-28T04:12:20.970732+0000","last_became_active":"2021-01-28T04:11:20.761886+0000","last_became_peered":"2021-01-28T04:11:20.761886+0000","last_unstale":"2021-01-28T04:12:20.970732+0000","last_undegraded":"2021-01-28T04:12:20.970732+0000","last_fullsized":"2021-01-28T04:12:20.970732+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986187+0000","last_change":"2021-01-28T04:11:17.633281+0000","last_active":"2021-01-28T04:12:20.986187+0000","last_peered":"2021-01-28T04:12:20.986187+0000","last_clean":"2021-01-28T04:12:20.986187+0000","last_became_active":"2021-01-28T04:11:17.632888+0000","last_became_peered":"2021-01-28T04:11:17.632888+0000","last_unstale":"2021-01-28T04:12:20.986187+0000","last_undegraded":"2021-01-28T04:12:20.986187+0000","last_fullsized":"2021-01-28T04:12:20.986187+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967169+0000","last_change":"2021-01-28T04:10:59.354291+0000","last_active":"2021-01-28T04:12:20.967169+0000","last_peered":"2021-01-28T04:12:20.967169+0000","last_clean":"2021-01-28T04:12:20.967169+0000","last_became_active":"2021-01-28T04:10:59.353807+0000","last_became_peered":"2021-01-28T04:10:59.353807+0000","last_unstale":"2021-01-28T04:12:20.967169+0000","last_undegraded":"2021-01-28T04:12:20.967169+0000","last_fullsized":"2021-01-28T04:12:20.967169+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"60'22","reported_seq":"64","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.970320+0000","last_change":"2021-01-28T04:11:15.613848+0000","last_active":"2021-01-28T04:12:20.970320+0000","last_peered":"2021-01-28T04:12:20.970320+0000","last_clean":"2021-01-28T04:12:20.970320+0000","last_became_active":"2021-01-28T04:11:15.613184+0000","last_became_peered":"2021-01-28T04:11:15.613184+0000","last_unstale":"2021-01-28T04:12:20.970320+0000","last_undegraded":"2021-01-28T04:12:20.970320+0000","last_fullsized":"2021-01-28T04:12:20.970320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":49,"num_read_kb":31,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986339+0000","last_change":"2021-01-28T04:11:20.763668+0000","last_active":"2021-01-28T04:12:20.986339+0000","last_peered":"2021-01-28T04:12:20.986339+0000","last_clean":"2021-01-28T04:12:20.986339+0000","last_became_active":"2021-01-28T04:11:20.762673+0000","last_became_peered":"2021-01-28T04:11:20.762673+0000","last_unstale":"2021-01-28T04:12:20.986339+0000","last_undegraded":"2021-01-28T04:12:20.986339+0000","last_fullsized":"2021-01-28T04:12:20.986339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978624+0000","last_change":"2021-01-28T04:11:17.631774+0000","last_active":"2021-01-28T04:12:20.978624+0000","last_peered":"2021-01-28T04:12:20.978624+0000","last_clean":"2021-01-28T04:12:20.978624+0000","last_became_active":"2021-01-28T04:11:17.631181+0000","last_became_peered":"2021-01-28T04:11:17.631181+0000","last_unstale":"2021-01-28T04:12:20.978624+0000","last_undegraded":"2021-01-28T04:12:20.978624+0000","last_fullsized":"2021-01-28T04:12:20.978624+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986150+0000","last_change":"2021-01-28T04:10:59.344847+0000","last_active":"2021-01-28T04:12:20.986150+0000","last_peered":"2021-01-28T04:12:20.986150+0000","last_clean":"2021-01-28T04:12:20.986150+0000","last_became_active":"2021-01-28T04:10:59.344431+0000","last_became_peered":"2021-01-28T04:10:59.344431+0000","last_unstale":"2021-01-28T04:12:20.986150+0000","last_undegraded":"2021-01-28T04:12:20.986150+0000","last_fullsized":"2021-01-28T04:12:20.986150+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976462+0000","last_change":"2021-01-28T04:11:15.612609+0000","last_active":"2021-01-28T04:12:20.976462+0000","last_peered":"2021-01-28T04:12:20.976462+0000","last_clean":"2021-01-28T04:12:20.976462+0000","last_became_active":"2021-01-28T04:11:15.612195+0000","last_became_peered":"2021-01-28T04:11:15.612195+0000","last_unstale":"2021-01-28T04:12:20.976462+0000","last_undegraded":"2021-01-28T04:12:20.976462+0000","last_fullsized":"2021-01-28T04:12:20.976462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978212+0000","last_change":"2021-01-28T04:11:20.671893+0000","last_active":"2021-01-28T04:12:20.978212+0000","last_peered":"2021-01-28T04:12:20.978212+0000","last_clean":"2021-01-28T04:12:20.978212+0000","last_became_active":"2021-01-28T04:11:20.671368+0000","last_became_peered":"2021-01-28T04:11:20.671368+0000","last_unstale":"2021-01-28T04:12:20.978212+0000","last_undegraded":"2021-01-28T04:12:20.978212+0000","last_fullsized":"2021-01-28T04:12:20.978212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968612+0000","last_change":"2021-01-28T04:11:17.639061+0000","last_active":"2021-01-28T04:12:20.968612+0000","last_peered":"2021-01-28T04:12:20.968612+0000","last_clean":"2021-01-28T04:12:20.968612+0000","last_became_active":"2021-01-28T04:11:17.638706+0000","last_became_peered":"2021-01-28T04:11:17.638706+0000","last_unstale":"2021-01-28T04:12:20.968612+0000","last_undegraded":"2021-01-28T04:12:20.968612+0000","last_fullsized":"2021-01-28T04:12:20.968612+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966370+0000","last_change":"2021-01-28T04:10:54.288994+0000","last_active":"2021-01-28T04:12:20.966370+0000","last_peered":"2021-01-28T04:12:20.966370+0000","last_clean":"2021-01-28T04:12:20.966370+0000","last_became_active":"2021-01-28T04:10:54.288565+0000","last_became_peered":"2021-01-28T04:10:54.288565+0000","last_unstale":"2021-01-28T04:12:20.966370+0000","last_undegraded":"2021-01-28T04:12:20.966370+0000","last_fullsized":"2021-01-28T04:12:20.966370+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'23","reported_seq":"64","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987206+0000","last_change":"2021-01-28T04:11:15.613962+0000","last_active":"2021-01-28T04:12:20.987206+0000","last_peered":"2021-01-28T04:12:20.987206+0000","last_clean":"2021-01-28T04:12:20.987206+0000","last_became_active":"2021-01-28T04:11:15.613539+0000","last_became_peered":"2021-01-28T04:11:15.613539+0000","last_unstale":"2021-01-28T04:12:20.987206+0000","last_undegraded":"2021-01-28T04:12:20.987206+0000","last_fullsized":"2021-01-28T04:12:20.987206+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":50,"num_read_kb":30,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984617+0000","last_change":"2021-01-28T04:11:20.668683+0000","last_active":"2021-01-28T04:12:20.984617+0000","last_peered":"2021-01-28T04:12:20.984617+0000","last_clean":"2021-01-28T04:12:20.984617+0000","last_became_active":"2021-01-28T04:11:20.667602+0000","last_became_peered":"2021-01-28T04:11:20.667602+0000","last_unstale":"2021-01-28T04:12:20.984617+0000","last_undegraded":"2021-01-28T04:12:20.984617+0000","last_fullsized":"2021-01-28T04:12:20.984617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"55'2","reported_seq":"53","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:03.786769+0000","last_change":"2021-01-28T04:11:17.628353+0000","last_active":"2021-01-28T04:14:03.786769+0000","last_peered":"2021-01-28T04:14:03.786769+0000","last_clean":"2021-01-28T04:14:03.786769+0000","last_became_active":"2021-01-28T04:11:17.627880+0000","last_became_peered":"2021-01-28T04:11:17.627880+0000","last_unstale":"2021-01-28T04:14:03.786769+0000","last_undegraded":"2021-01-28T04:14:03.786769+0000","last_fullsized":"2021-01-28T04:14:03.786769+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978143+0000","last_change":"2021-01-28T04:10:59.352408+0000","last_active":"2021-01-28T04:12:20.978143+0000","last_peered":"2021-01-28T04:12:20.978143+0000","last_clean":"2021-01-28T04:12:20.978143+0000","last_became_active":"2021-01-28T04:10:59.351956+0000","last_became_peered":"2021-01-28T04:10:59.351956+0000","last_unstale":"2021-01-28T04:12:20.978143+0000","last_undegraded":"2021-01-28T04:12:20.978143+0000","last_fullsized":"2021-01-28T04:12:20.978143+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"60'22","reported_seq":"60","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968536+0000","last_change":"2021-01-28T04:11:15.630576+0000","last_active":"2021-01-28T04:12:20.968536+0000","last_peered":"2021-01-28T04:12:20.968536+0000","last_clean":"2021-01-28T04:12:20.968536+0000","last_became_active":"2021-01-28T04:11:15.630203+0000","last_became_peered":"2021-01-28T04:11:15.630203+0000","last_unstale":"2021-01-28T04:12:20.968536+0000","last_undegraded":"2021-01-28T04:12:20.968536+0000","last_fullsized":"2021-01-28T04:12:20.968536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967660+0000","last_change":"2021-01-28T04:11:20.764030+0000","last_active":"2021-01-28T04:12:20.967660+0000","last_peered":"2021-01-28T04:12:20.967660+0000","last_clean":"2021-01-28T04:12:20.967660+0000","last_became_active":"2021-01-28T04:11:20.763048+0000","last_became_peered":"2021-01-28T04:11:20.763048+0000","last_unstale":"2021-01-28T04:12:20.967660+0000","last_undegraded":"2021-01-28T04:12:20.967660+0000","last_fullsized":"2021-01-28T04:12:20.967660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982437+0000","last_change":"2021-01-28T04:11:17.623468+0000","last_active":"2021-01-28T04:12:20.982437+0000","last_peered":"2021-01-28T04:12:20.982437+0000","last_clean":"2021-01-28T04:12:20.982437+0000","last_became_active":"2021-01-28T04:11:17.623054+0000","last_became_peered":"2021-01-28T04:11:17.623054+0000","last_unstale":"2021-01-28T04:12:20.982437+0000","last_undegraded":"2021-01-28T04:12:20.982437+0000","last_fullsized":"2021-01-28T04:12:20.982437+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'1","reported_seq":"30","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987330+0000","last_change":"2021-01-28T04:10:58.352209+0000","last_active":"2021-01-28T04:12:20.987330+0000","last_peered":"2021-01-28T04:12:20.987330+0000","last_clean":"2021-01-28T04:12:20.987330+0000","last_became_active":"2021-01-28T04:10:58.343247+0000","last_became_peered":"2021-01-28T04:10:58.343247+0000","last_unstale":"2021-01-28T04:12:20.987330+0000","last_undegraded":"2021-01-28T04:12:20.987330+0000","last_fullsized":"2021-01-28T04:12:20.987330+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"60'20","reported_seq":"58","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966690+0000","last_change":"2021-01-28T04:11:15.630454+0000","last_active":"2021-01-28T04:12:20.966690+0000","last_peered":"2021-01-28T04:12:20.966690+0000","last_clean":"2021-01-28T04:12:20.966690+0000","last_became_active":"2021-01-28T04:11:15.628560+0000","last_became_peered":"2021-01-28T04:11:15.628560+0000","last_unstale":"2021-01-28T04:12:20.966690+0000","last_undegraded":"2021-01-28T04:12:20.966690+0000","last_fullsized":"2021-01-28T04:12:20.966690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982154+0000","last_change":"2021-01-28T04:11:20.670169+0000","last_active":"2021-01-28T04:12:20.982154+0000","last_peered":"2021-01-28T04:12:20.982154+0000","last_clean":"2021-01-28T04:12:20.982154+0000","last_became_active":"2021-01-28T04:11:20.668869+0000","last_became_peered":"2021-01-28T04:11:20.668869+0000","last_unstale":"2021-01-28T04:12:20.982154+0000","last_undegraded":"2021-01-28T04:12:20.982154+0000","last_fullsized":"2021-01-28T04:12:20.982154+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984325+0000","last_change":"2021-01-28T04:11:17.629615+0000","last_active":"2021-01-28T04:12:20.984325+0000","last_peered":"2021-01-28T04:12:20.984325+0000","last_clean":"2021-01-28T04:12:20.984325+0000","last_became_active":"2021-01-28T04:11:17.629180+0000","last_became_peered":"2021-01-28T04:11:17.629180+0000","last_unstale":"2021-01-28T04:12:20.984325+0000","last_undegraded":"2021-01-28T04:12:20.984325+0000","last_fullsized":"2021-01-28T04:12:20.984325+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981280+0000","last_change":"2021-01-28T04:10:54.296826+0000","last_active":"2021-01-28T04:12:20.981280+0000","last_peered":"2021-01-28T04:12:20.981280+0000","last_clean":"2021-01-28T04:12:20.981280+0000","last_became_active":"2021-01-28T04:10:54.296387+0000","last_became_peered":"2021-01-28T04:10:54.296387+0000","last_unstale":"2021-01-28T04:12:20.981280+0000","last_undegraded":"2021-01-28T04:12:20.981280+0000","last_fullsized":"2021-01-28T04:12:20.981280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"60'12","reported_seq":"40","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.965826+0000","last_change":"2021-01-28T04:11:15.619160+0000","last_active":"2021-01-28T04:12:20.965826+0000","last_peered":"2021-01-28T04:12:20.965826+0000","last_clean":"2021-01-28T04:12:20.965826+0000","last_became_active":"2021-01-28T04:11:15.618782+0000","last_became_peered":"2021-01-28T04:11:15.618782+0000","last_unstale":"2021-01-28T04:12:20.965826+0000","last_undegraded":"2021-01-28T04:12:20.965826+0000","last_fullsized":"2021-01-28T04:12:20.965826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966160+0000","last_change":"2021-01-28T04:11:20.681912+0000","last_active":"2021-01-28T04:12:20.966160+0000","last_peered":"2021-01-28T04:12:20.966160+0000","last_clean":"2021-01-28T04:12:20.966160+0000","last_became_active":"2021-01-28T04:11:20.681543+0000","last_became_peered":"2021-01-28T04:11:20.681543+0000","last_unstale":"2021-01-28T04:12:20.966160+0000","last_undegraded":"2021-01-28T04:12:20.966160+0000","last_fullsized":"2021-01-28T04:12:20.966160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976955+0000","last_change":"2021-01-28T04:11:17.617624+0000","last_active":"2021-01-28T04:12:20.976955+0000","last_peered":"2021-01-28T04:12:20.976955+0000","last_clean":"2021-01-28T04:12:20.976955+0000","last_became_active":"2021-01-28T04:11:17.617104+0000","last_became_peered":"2021-01-28T04:11:17.617104+0000","last_unstale":"2021-01-28T04:12:20.976955+0000","last_undegraded":"2021-01-28T04:12:20.976955+0000","last_fullsized":"2021-01-28T04:12:20.976955+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"25","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978425+0000","last_change":"2021-01-28T04:10:54.297929+0000","last_active":"2021-01-28T04:12:20.978425+0000","last_peered":"2021-01-28T04:12:20.978425+0000","last_clean":"2021-01-28T04:12:20.978425+0000","last_became_active":"2021-01-28T04:10:54.295428+0000","last_became_peered":"2021-01-28T04:10:54.295428+0000","last_unstale":"2021-01-28T04:12:20.978425+0000","last_undegraded":"2021-01-28T04:12:20.978425+0000","last_fullsized":"2021-01-28T04:12:20.978425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'15","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987676+0000","last_change":"2021-01-28T04:11:15.616274+0000","last_active":"2021-01-28T04:12:20.987676+0000","last_peered":"2021-01-28T04:12:20.987676+0000","last_clean":"2021-01-28T04:12:20.987676+0000","last_became_active":"2021-01-28T04:11:15.615902+0000","last_became_peered":"2021-01-28T04:11:15.615902+0000","last_unstale":"2021-01-28T04:12:20.987676+0000","last_undegraded":"2021-01-28T04:12:20.987676+0000","last_fullsized":"2021-01-28T04:12:20.987676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966641+0000","last_change":"2021-01-28T04:11:20.676769+0000","last_active":"2021-01-28T04:12:20.966641+0000","last_peered":"2021-01-28T04:12:20.966641+0000","last_clean":"2021-01-28T04:12:20.966641+0000","last_became_active":"2021-01-28T04:11:20.675777+0000","last_became_peered":"2021-01-28T04:11:20.675777+0000","last_unstale":"2021-01-28T04:12:20.966641+0000","last_undegraded":"2021-01-28T04:12:20.966641+0000","last_fullsized":"2021-01-28T04:12:20.966641+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967437+0000","last_change":"2021-01-28T04:11:17.626405+0000","last_active":"2021-01-28T04:12:20.967437+0000","last_peered":"2021-01-28T04:12:20.967437+0000","last_clean":"2021-01-28T04:12:20.967437+0000","last_became_active":"2021-01-28T04:11:17.625949+0000","last_became_peered":"2021-01-28T04:11:17.625949+0000","last_unstale":"2021-01-28T04:12:20.967437+0000","last_undegraded":"2021-01-28T04:12:20.967437+0000","last_fullsized":"2021-01-28T04:12:20.967437+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987131+0000","last_change":"2021-01-28T04:10:54.301559+0000","last_active":"2021-01-28T04:12:20.987131+0000","last_peered":"2021-01-28T04:12:20.987131+0000","last_clean":"2021-01-28T04:12:20.987131+0000","last_became_active":"2021-01-28T04:10:54.301175+0000","last_became_peered":"2021-01-28T04:10:54.301175+0000","last_unstale":"2021-01-28T04:12:20.987131+0000","last_undegraded":"2021-01-28T04:12:20.987131+0000","last_fullsized":"2021-01-28T04:12:20.987131+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'15","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976879+0000","last_change":"2021-01-28T04:11:15.615936+0000","last_active":"2021-01-28T04:12:20.976879+0000","last_peered":"2021-01-28T04:12:20.976879+0000","last_clean":"2021-01-28T04:12:20.976879+0000","last_became_active":"2021-01-28T04:11:15.615461+0000","last_became_peered":"2021-01-28T04:11:15.615461+0000","last_unstale":"2021-01-28T04:12:20.976879+0000","last_undegraded":"2021-01-28T04:12:20.976879+0000","last_fullsized":"2021-01-28T04:12:20.976879+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.988714+0000","last_change":"2021-01-28T04:11:20.672989+0000","last_active":"2021-01-28T04:12:20.988714+0000","last_peered":"2021-01-28T04:12:20.988714+0000","last_clean":"2021-01-28T04:12:20.988714+0000","last_became_active":"2021-01-28T04:11:20.672381+0000","last_became_peered":"2021-01-28T04:11:20.672381+0000","last_unstale":"2021-01-28T04:12:20.988714+0000","last_undegraded":"2021-01-28T04:12:20.988714+0000","last_fullsized":"2021-01-28T04:12:20.988714+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"55'2","reported_seq":"54","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.784934+0000","last_change":"2021-01-28T04:11:17.619763+0000","last_active":"2021-01-28T04:14:08.784934+0000","last_peered":"2021-01-28T04:14:08.784934+0000","last_clean":"2021-01-28T04:14:08.784934+0000","last_became_active":"2021-01-28T04:11:17.619405+0000","last_became_peered":"2021-01-28T04:11:17.619405+0000","last_unstale":"2021-01-28T04:14:08.784934+0000","last_undegraded":"2021-01-28T04:14:08.784934+0000","last_fullsized":"2021-01-28T04:14:08.784934+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968509+0000","last_change":"2021-01-28T04:10:54.305888+0000","last_active":"2021-01-28T04:12:20.968509+0000","last_peered":"2021-01-28T04:12:20.968509+0000","last_clean":"2021-01-28T04:12:20.968509+0000","last_became_active":"2021-01-28T04:10:54.305516+0000","last_became_peered":"2021-01-28T04:10:54.305516+0000","last_unstale":"2021-01-28T04:12:20.968509+0000","last_undegraded":"2021-01-28T04:12:20.968509+0000","last_fullsized":"2021-01-28T04:12:20.968509+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'19","reported_seq":"57","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981003+0000","last_change":"2021-01-28T04:11:15.628402+0000","last_active":"2021-01-28T04:12:20.981003+0000","last_peered":"2021-01-28T04:12:20.981003+0000","last_clean":"2021-01-28T04:12:20.981003+0000","last_became_active":"2021-01-28T04:11:15.628030+0000","last_became_peered":"2021-01-28T04:11:15.628030+0000","last_unstale":"2021-01-28T04:12:20.981003+0000","last_undegraded":"2021-01-28T04:12:20.981003+0000","last_fullsized":"2021-01-28T04:12:20.981003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967797+0000","last_change":"2021-01-28T04:11:20.675748+0000","last_active":"2021-01-28T04:12:20.967797+0000","last_peered":"2021-01-28T04:12:20.967797+0000","last_clean":"2021-01-28T04:12:20.967797+0000","last_became_active":"2021-01-28T04:11:20.674748+0000","last_became_peered":"2021-01-28T04:11:20.674748+0000","last_unstale":"2021-01-28T04:12:20.967797+0000","last_undegraded":"2021-01-28T04:12:20.967797+0000","last_fullsized":"2021-01-28T04:12:20.967797+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"55'2","reported_seq":"53","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:03.786585+0000","last_change":"2021-01-28T04:11:17.630860+0000","last_active":"2021-01-28T04:14:03.786585+0000","last_peered":"2021-01-28T04:14:03.786585+0000","last_clean":"2021-01-28T04:14:03.786585+0000","last_became_active":"2021-01-28T04:11:17.630472+0000","last_became_peered":"2021-01-28T04:11:17.630472+0000","last_unstale":"2021-01-28T04:14:03.786585+0000","last_undegraded":"2021-01-28T04:14:03.786585+0000","last_fullsized":"2021-01-28T04:14:03.786585+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"45'2","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978671+0000","last_change":"2021-01-28T04:10:59.457241+0000","last_active":"2021-01-28T04:12:20.978671+0000","last_peered":"2021-01-28T04:12:20.978671+0000","last_clean":"2021-01-28T04:12:20.978671+0000","last_became_active":"2021-01-28T04:10:59.353495+0000","last_became_peered":"2021-01-28T04:10:59.353495+0000","last_unstale":"2021-01-28T04:12:20.978671+0000","last_undegraded":"2021-01-28T04:12:20.978671+0000","last_fullsized":"2021-01-28T04:12:20.978671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"60'26","reported_seq":"71","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967994+0000","last_change":"2021-01-28T04:11:15.629037+0000","last_active":"2021-01-28T04:12:20.967994+0000","last_peered":"2021-01-28T04:12:20.967994+0000","last_clean":"2021-01-28T04:12:20.967994+0000","last_became_active":"2021-01-28T04:11:15.628589+0000","last_became_peered":"2021-01-28T04:11:15.628589+0000","last_unstale":"2021-01-28T04:12:20.967994+0000","last_undegraded":"2021-01-28T04:12:20.967994+0000","last_fullsized":"2021-01-28T04:12:20.967994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982183+0000","last_change":"2021-01-28T04:11:20.762404+0000","last_active":"2021-01-28T04:12:20.982183+0000","last_peered":"2021-01-28T04:12:20.982183+0000","last_clean":"2021-01-28T04:12:20.982183+0000","last_became_active":"2021-01-28T04:11:20.761936+0000","last_became_peered":"2021-01-28T04:11:20.761936+0000","last_unstale":"2021-01-28T04:12:20.982183+0000","last_undegraded":"2021-01-28T04:12:20.982183+0000","last_fullsized":"2021-01-28T04:12:20.982183+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981097+0000","last_change":"2021-01-28T04:11:17.627364+0000","last_active":"2021-01-28T04:12:20.981097+0000","last_peered":"2021-01-28T04:12:20.981097+0000","last_clean":"2021-01-28T04:12:20.981097+0000","last_became_active":"2021-01-28T04:11:17.626795+0000","last_became_peered":"2021-01-28T04:11:17.626795+0000","last_unstale":"2021-01-28T04:12:20.981097+0000","last_undegraded":"2021-01-28T04:12:20.981097+0000","last_fullsized":"2021-01-28T04:12:20.981097+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"50'2","reported_seq":"31","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.985581+0000","last_change":"2021-01-28T04:10:54.292855+0000","last_active":"2021-01-28T04:12:20.985581+0000","last_peered":"2021-01-28T04:12:20.985581+0000","last_clean":"2021-01-28T04:12:20.985581+0000","last_became_active":"2021-01-28T04:10:54.292400+0000","last_became_peered":"2021-01-28T04:10:54.292400+0000","last_unstale":"2021-01-28T04:12:20.985581+0000","last_undegraded":"2021-01-28T04:12:20.985581+0000","last_fullsized":"2021-01-28T04:12:20.985581+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'13","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.970618+0000","last_change":"2021-01-28T04:11:15.629147+0000","last_active":"2021-01-28T04:12:20.970618+0000","last_peered":"2021-01-28T04:12:20.970618+0000","last_clean":"2021-01-28T04:12:20.970618+0000","last_became_active":"2021-01-28T04:11:15.628780+0000","last_became_peered":"2021-01-28T04:11:15.628780+0000","last_unstale":"2021-01-28T04:12:20.970618+0000","last_undegraded":"2021-01-28T04:12:20.970618+0000","last_fullsized":"2021-01-28T04:12:20.970618+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976134+0000","last_change":"2021-01-28T04:11:20.669742+0000","last_active":"2021-01-28T04:12:20.976134+0000","last_peered":"2021-01-28T04:12:20.976134+0000","last_clean":"2021-01-28T04:12:20.976134+0000","last_became_active":"2021-01-28T04:11:20.669331+0000","last_became_peered":"2021-01-28T04:11:20.669331+0000","last_unstale":"2021-01-28T04:12:20.976134+0000","last_undegraded":"2021-01-28T04:12:20.976134+0000","last_fullsized":"2021-01-28T04:12:20.976134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.970837+0000","last_change":"2021-01-28T04:11:17.619979+0000","last_active":"2021-01-28T04:12:20.970837+0000","last_peered":"2021-01-28T04:12:20.970837+0000","last_clean":"2021-01-28T04:12:20.970837+0000","last_became_active":"2021-01-28T04:11:17.619574+0000","last_became_peered":"2021-01-28T04:11:17.619574+0000","last_unstale":"2021-01-28T04:12:20.970837+0000","last_undegraded":"2021-01-28T04:12:20.970837+0000","last_fullsized":"2021-01-28T04:12:20.970837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"45'2","reported_seq":"34","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.974652+0000","last_change":"2021-01-28T04:10:54.307652+0000","last_active":"2021-01-28T04:12:20.974652+0000","last_peered":"2021-01-28T04:12:20.974652+0000","last_clean":"2021-01-28T04:12:20.974652+0000","last_became_active":"2021-01-28T04:10:54.307237+0000","last_became_peered":"2021-01-28T04:10:54.307237+0000","last_unstale":"2021-01-28T04:12:20.974652+0000","last_undegraded":"2021-01-28T04:12:20.974652+0000","last_fullsized":"2021-01-28T04:12:20.974652+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'29","reported_seq":"79","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968180+0000","last_change":"2021-01-28T04:11:15.630524+0000","last_active":"2021-01-28T04:12:20.968180+0000","last_peered":"2021-01-28T04:12:20.968180+0000","last_clean":"2021-01-28T04:12:20.968180+0000","last_became_active":"2021-01-28T04:11:15.629826+0000","last_became_peered":"2021-01-28T04:11:15.629826+0000","last_unstale":"2021-01-28T04:12:20.968180+0000","last_undegraded":"2021-01-28T04:12:20.968180+0000","last_fullsized":"2021-01-28T04:12:20.968180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":62,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967546+0000","last_change":"2021-01-28T04:11:20.683685+0000","last_active":"2021-01-28T04:12:20.967546+0000","last_peered":"2021-01-28T04:12:20.967546+0000","last_clean":"2021-01-28T04:12:20.967546+0000","last_became_active":"2021-01-28T04:11:20.683319+0000","last_became_peered":"2021-01-28T04:11:20.683319+0000","last_unstale":"2021-01-28T04:12:20.967546+0000","last_undegraded":"2021-01-28T04:12:20.967546+0000","last_fullsized":"2021-01-28T04:12:20.967546+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"50'2","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.988493+0000","last_change":"2021-01-28T04:10:59.453102+0000","last_active":"2021-01-28T04:12:20.988493+0000","last_peered":"2021-01-28T04:12:20.988493+0000","last_clean":"2021-01-28T04:12:20.988493+0000","last_became_active":"2021-01-28T04:10:59.350707+0000","last_became_peered":"2021-01-28T04:10:59.350707+0000","last_unstale":"2021-01-28T04:12:20.988493+0000","last_undegraded":"2021-01-28T04:12:20.988493+0000","last_fullsized":"2021-01-28T04:12:20.988493+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":10,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"60'27","reported_seq":"76","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.983110+0000","last_change":"2021-01-28T04:11:15.620355+0000","last_active":"2021-01-28T04:12:20.983110+0000","last_peered":"2021-01-28T04:12:20.983110+0000","last_clean":"2021-01-28T04:12:20.983110+0000","last_became_active":"2021-01-28T04:11:15.619966+0000","last_became_peered":"2021-01-28T04:11:15.619966+0000","last_unstale":"2021-01-28T04:12:20.983110+0000","last_undegraded":"2021-01-28T04:12:20.983110+0000","last_fullsized":"2021-01-28T04:12:20.983110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.974532+0000","last_change":"2021-01-28T04:11:17.629483+0000","last_active":"2021-01-28T04:12:20.974532+0000","last_peered":"2021-01-28T04:12:20.974532+0000","last_clean":"2021-01-28T04:12:20.974532+0000","last_became_active":"2021-01-28T04:11:17.629094+0000","last_became_peered":"2021-01-28T04:11:17.629094+0000","last_unstale":"2021-01-28T04:12:20.974532+0000","last_undegraded":"2021-01-28T04:12:20.974532+0000","last_fullsized":"2021-01-28T04:12:20.974532+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966778+0000","last_change":"2021-01-28T04:11:20.677041+0000","last_active":"2021-01-28T04:12:20.966778+0000","last_peered":"2021-01-28T04:12:20.966778+0000","last_clean":"2021-01-28T04:12:20.966778+0000","last_became_active":"2021-01-28T04:11:20.676610+0000","last_became_peered":"2021-01-28T04:11:20.676610+0000","last_unstale":"2021-01-28T04:12:20.966778+0000","last_undegraded":"2021-01-28T04:12:20.966778+0000","last_fullsized":"2021-01-28T04:12:20.966778+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"34","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978049+0000","last_change":"2021-01-28T04:10:59.351160+0000","last_active":"2021-01-28T04:12:20.978049+0000","last_peered":"2021-01-28T04:12:20.978049+0000","last_clean":"2021-01-28T04:12:20.978049+0000","last_became_active":"2021-01-28T04:10:59.350473+0000","last_became_peered":"2021-01-28T04:10:59.350473+0000","last_unstale":"2021-01-28T04:12:20.978049+0000","last_undegraded":"2021-01-28T04:12:20.978049+0000","last_fullsized":"2021-01-28T04:12:20.978049+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'22","reported_seq":"59","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.977058+0000","last_change":"2021-01-28T04:11:15.612138+0000","last_active":"2021-01-28T04:12:20.977058+0000","last_peered":"2021-01-28T04:12:20.977058+0000","last_clean":"2021-01-28T04:12:20.977058+0000","last_became_active":"2021-01-28T04:11:15.610272+0000","last_became_peered":"2021-01-28T04:11:15.610272+0000","last_unstale":"2021-01-28T04:12:20.977058+0000","last_undegraded":"2021-01-28T04:12:20.977058+0000","last_fullsized":"2021-01-28T04:12:20.977058+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"55'2","reported_seq":"53","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:03.784738+0000","last_change":"2021-01-28T04:11:17.632119+0000","last_active":"2021-01-28T04:14:03.784738+0000","last_peered":"2021-01-28T04:14:03.784738+0000","last_clean":"2021-01-28T04:14:03.784738+0000","last_became_active":"2021-01-28T04:11:17.631728+0000","last_became_peered":"2021-01-28T04:11:17.631728+0000","last_unstale":"2021-01-28T04:14:03.784738+0000","last_undegraded":"2021-01-28T04:14:03.784738+0000","last_fullsized":"2021-01-28T04:14:03.784738+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.971563+0000","last_change":"2021-01-28T04:11:20.683162+0000","last_active":"2021-01-28T04:12:20.971563+0000","last_peered":"2021-01-28T04:12:20.971563+0000","last_clean":"2021-01-28T04:12:20.971563+0000","last_became_active":"2021-01-28T04:11:20.682818+0000","last_became_peered":"2021-01-28T04:11:20.682818+0000","last_unstale":"2021-01-28T04:12:20.971563+0000","last_undegraded":"2021-01-28T04:12:20.971563+0000","last_fullsized":"2021-01-28T04:12:20.971563+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"60'2","reported_seq":"61","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:03.021958+0000","last_change":"2021-01-28T04:10:54.300484+0000","last_active":"2021-01-28T04:14:03.021958+0000","last_peered":"2021-01-28T04:14:03.021958+0000","last_clean":"2021-01-28T04:14:03.021958+0000","last_became_active":"2021-01-28T04:10:54.300102+0000","last_became_peered":"2021-01-28T04:10:54.300102+0000","last_unstale":"2021-01-28T04:14:03.021958+0000","last_undegraded":"2021-01-28T04:14:03.021958+0000","last_fullsized":"2021-01-28T04:14:03.021958+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"60'31","reported_seq":"79","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978095+0000","last_change":"2021-01-28T04:11:15.618251+0000","last_active":"2021-01-28T04:12:20.978095+0000","last_peered":"2021-01-28T04:12:20.978095+0000","last_clean":"2021-01-28T04:12:20.978095+0000","last_became_active":"2021-01-28T04:11:15.617850+0000","last_became_peered":"2021-01-28T04:11:15.617850+0000","last_unstale":"2021-01-28T04:12:20.978095+0000","last_undegraded":"2021-01-28T04:12:20.978095+0000","last_fullsized":"2021-01-28T04:12:20.978095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":42,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968970+0000","last_change":"2021-01-28T04:11:17.628341+0000","last_active":"2021-01-28T04:12:20.968970+0000","last_peered":"2021-01-28T04:12:20.968970+0000","last_clean":"2021-01-28T04:12:20.968970+0000","last_became_active":"2021-01-28T04:11:17.627918+0000","last_became_peered":"2021-01-28T04:11:17.627918+0000","last_unstale":"2021-01-28T04:12:20.968970+0000","last_undegraded":"2021-01-28T04:12:20.968970+0000","last_fullsized":"2021-01-28T04:12:20.968970+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982881+0000","last_change":"2021-01-28T04:11:20.762177+0000","last_active":"2021-01-28T04:12:20.982881+0000","last_peered":"2021-01-28T04:12:20.982881+0000","last_clean":"2021-01-28T04:12:20.982881+0000","last_became_active":"2021-01-28T04:11:20.761235+0000","last_became_peered":"2021-01-28T04:11:20.761235+0000","last_unstale":"2021-01-28T04:12:20.982881+0000","last_undegraded":"2021-01-28T04:12:20.982881+0000","last_fullsized":"2021-01-28T04:12:20.982881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"60'5","reported_seq":"187","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:10.748504+0000","last_change":"2021-01-28T04:11:14.605443+0000","last_active":"2021-01-28T04:14:10.748504+0000","last_peered":"2021-01-28T04:14:10.748504+0000","last_clean":"2021-01-28T04:14:10.748504+0000","last_became_active":"2021-01-28T04:11:14.605057+0000","last_became_peered":"2021-01-28T04:11:14.605057+0000","last_unstale":"2021-01-28T04:14:10.748504+0000","last_undegraded":"2021-01-28T04:14:10.748504+0000","last_fullsized":"2021-01-28T04:14:10.748504+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_clean_scrub_stamp":"2021-01-28T04:11:13.576846+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":166,"num_read_kb":161,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"25","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.974976+0000","last_change":"2021-01-28T04:10:54.298297+0000","last_active":"2021-01-28T04:12:20.974976+0000","last_peered":"2021-01-28T04:12:20.974976+0000","last_clean":"2021-01-28T04:12:20.974976+0000","last_became_active":"2021-01-28T04:10:54.297767+0000","last_became_peered":"2021-01-28T04:10:54.297767+0000","last_unstale":"2021-01-28T04:12:20.974976+0000","last_undegraded":"2021-01-28T04:12:20.974976+0000","last_fullsized":"2021-01-28T04:12:20.974976+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'21","reported_seq":"28","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:12:22.040522+0000","last_change":"2021-01-28T04:12:22.040522+0000","last_active":"2021-01-28T04:12:22.040522+0000","last_peered":"2021-01-28T04:12:22.040522+0000","last_clean":"2021-01-28T04:12:22.040522+0000","last_became_active":"2021-01-28T04:12:21.992345+0000","last_became_peered":"2021-01-28T04:12:21.992345+0000","last_unstale":"2021-01-28T04:12:22.040522+0000","last_undegraded":"2021-01-28T04:12:22.040522+0000","last_fullsized":"2021-01-28T04:12:22.040522+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.977290+0000","last_change":"2021-01-28T04:11:17.620144+0000","last_active":"2021-01-28T04:12:20.977290+0000","last_peered":"2021-01-28T04:12:20.977290+0000","last_clean":"2021-01-28T04:12:20.977290+0000","last_became_active":"2021-01-28T04:11:17.619453+0000","last_became_peered":"2021-01-28T04:11:17.619453+0000","last_unstale":"2021-01-28T04:12:20.977290+0000","last_undegraded":"2021-01-28T04:12:20.977290+0000","last_fullsized":"2021-01-28T04:12:20.977290+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981160+0000","last_change":"2021-01-28T04:11:20.676481+0000","last_active":"2021-01-28T04:12:20.981160+0000","last_peered":"2021-01-28T04:12:20.981160+0000","last_clean":"2021-01-28T04:12:20.981160+0000","last_became_active":"2021-01-28T04:11:20.676011+0000","last_became_peered":"2021-01-28T04:11:20.676011+0000","last_unstale":"2021-01-28T04:12:20.981160+0000","last_undegraded":"2021-01-28T04:12:20.981160+0000","last_fullsized":"2021-01-28T04:12:20.981160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"19","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967471+0000","last_change":"2021-01-28T04:11:14.605941+0000","last_active":"2021-01-28T04:12:20.967471+0000","last_peered":"2021-01-28T04:12:20.967471+0000","last_clean":"2021-01-28T04:12:20.967471+0000","last_became_active":"2021-01-28T04:11:14.605387+0000","last_became_peered":"2021-01-28T04:11:14.605387+0000","last_unstale":"2021-01-28T04:12:20.967471+0000","last_undegraded":"2021-01-28T04:12:20.967471+0000","last_fullsized":"2021-01-28T04:12:20.967471+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_clean_scrub_stamp":"2021-01-28T04:11:13.576846+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.979009+0000","last_change":"2021-01-28T04:10:59.352635+0000","last_active":"2021-01-28T04:12:20.979009+0000","last_peered":"2021-01-28T04:12:20.979009+0000","last_clean":"2021-01-28T04:12:20.979009+0000","last_became_active":"2021-01-28T04:10:59.351748+0000","last_became_peered":"2021-01-28T04:10:59.351748+0000","last_unstale":"2021-01-28T04:12:20.979009+0000","last_undegraded":"2021-01-28T04:12:20.979009+0000","last_fullsized":"2021-01-28T04:12:20.979009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981846+0000","last_change":"2021-01-28T04:10:59.357806+0000","last_active":"2021-01-28T04:12:20.981846+0000","last_peered":"2021-01-28T04:12:20.981846+0000","last_clean":"2021-01-28T04:12:20.981846+0000","last_became_active":"2021-01-28T04:10:59.357187+0000","last_became_peered":"2021-01-28T04:10:59.357187+0000","last_unstale":"2021-01-28T04:12:20.981846+0000","last_undegraded":"2021-01-28T04:12:20.981846+0000","last_fullsized":"2021-01-28T04:12:20.981846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:06:15.076818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:06:15.076818+0000","last_clean_scrub_stamp":"2021-01-28T04:06:15.076818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"60'15","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986992+0000","last_change":"2021-01-28T04:11:15.626442+0000","last_active":"2021-01-28T04:12:20.986992+0000","last_peered":"2021-01-28T04:12:20.986992+0000","last_clean":"2021-01-28T04:12:20.986992+0000","last_became_active":"2021-01-28T04:11:15.625659+0000","last_became_peered":"2021-01-28T04:11:15.625659+0000","last_unstale":"2021-01-28T04:12:20.986992+0000","last_undegraded":"2021-01-28T04:12:20.986992+0000","last_fullsized":"2021-01-28T04:12:20.986992+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984228+0000","last_change":"2021-01-28T04:11:17.619525+0000","last_active":"2021-01-28T04:12:20.984228+0000","last_peered":"2021-01-28T04:12:20.984228+0000","last_clean":"2021-01-28T04:12:20.984228+0000","last_became_active":"2021-01-28T04:11:17.619030+0000","last_became_peered":"2021-01-28T04:11:17.619030+0000","last_unstale":"2021-01-28T04:12:20.984228+0000","last_undegraded":"2021-01-28T04:12:20.984228+0000","last_fullsized":"2021-01-28T04:12:20.984228+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.977873+0000","last_change":"2021-01-28T04:11:20.675590+0000","last_active":"2021-01-28T04:12:20.977873+0000","last_peered":"2021-01-28T04:12:20.977873+0000","last_clean":"2021-01-28T04:12:20.977873+0000","last_became_active":"2021-01-28T04:11:20.675115+0000","last_became_peered":"2021-01-28T04:11:20.675115+0000","last_unstale":"2021-01-28T04:12:20.977873+0000","last_undegraded":"2021-01-28T04:12:20.977873+0000","last_fullsized":"2021-01-28T04:12:20.977873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"19","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967547+0000","last_change":"2021-01-28T04:11:14.600853+0000","last_active":"2021-01-28T04:12:20.967547+0000","last_peered":"2021-01-28T04:12:20.967547+0000","last_clean":"2021-01-28T04:12:20.967547+0000","last_became_active":"2021-01-28T04:11:14.600451+0000","last_became_peered":"2021-01-28T04:11:14.600451+0000","last_unstale":"2021-01-28T04:12:20.967547+0000","last_undegraded":"2021-01-28T04:12:20.967547+0000","last_fullsized":"2021-01-28T04:12:20.967547+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_clean_scrub_stamp":"2021-01-28T04:11:13.576846+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982178+0000","last_change":"2021-01-28T04:10:59.358319+0000","last_active":"2021-01-28T04:12:20.982178+0000","last_peered":"2021-01-28T04:12:20.982178+0000","last_clean":"2021-01-28T04:12:20.982178+0000","last_became_active":"2021-01-28T04:10:59.357447+0000","last_became_peered":"2021-01-28T04:10:59.357447+0000","last_unstale":"2021-01-28T04:12:20.982178+0000","last_undegraded":"2021-01-28T04:12:20.982178+0000","last_fullsized":"2021-01-28T04:12:20.982178+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'16","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967983+0000","last_change":"2021-01-28T04:11:15.627576+0000","last_active":"2021-01-28T04:12:20.967983+0000","last_peered":"2021-01-28T04:12:20.967983+0000","last_clean":"2021-01-28T04:12:20.967983+0000","last_became_active":"2021-01-28T04:11:15.627129+0000","last_became_peered":"2021-01-28T04:11:15.627129+0000","last_unstale":"2021-01-28T04:12:20.967983+0000","last_undegraded":"2021-01-28T04:12:20.967983+0000","last_fullsized":"2021-01-28T04:12:20.967983+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.980958+0000","last_change":"2021-01-28T04:11:17.631106+0000","last_active":"2021-01-28T04:12:20.980958+0000","last_peered":"2021-01-28T04:12:20.980958+0000","last_clean":"2021-01-28T04:12:20.980958+0000","last_became_active":"2021-01-28T04:11:17.630690+0000","last_became_peered":"2021-01-28T04:11:17.630690+0000","last_unstale":"2021-01-28T04:12:20.980958+0000","last_undegraded":"2021-01-28T04:12:20.980958+0000","last_fullsized":"2021-01-28T04:12:20.980958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976384+0000","last_change":"2021-01-28T04:11:20.762847+0000","last_active":"2021-01-28T04:12:20.976384+0000","last_peered":"2021-01-28T04:12:20.976384+0000","last_clean":"2021-01-28T04:12:20.976384+0000","last_became_active":"2021-01-28T04:11:20.761749+0000","last_became_peered":"2021-01-28T04:11:20.761749+0000","last_unstale":"2021-01-28T04:12:20.976384+0000","last_undegraded":"2021-01-28T04:12:20.976384+0000","last_fullsized":"2021-01-28T04:12:20.976384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.983135+0000","last_change":"2021-01-28T04:10:59.357324+0000","last_active":"2021-01-28T04:12:20.983135+0000","last_peered":"2021-01-28T04:12:20.983135+0000","last_clean":"2021-01-28T04:12:20.983135+0000","last_became_active":"2021-01-28T04:10:59.356419+0000","last_became_peered":"2021-01-28T04:10:59.356419+0000","last_unstale":"2021-01-28T04:12:20.983135+0000","last_undegraded":"2021-01-28T04:12:20.983135+0000","last_fullsized":"2021-01-28T04:12:20.983135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"60'27","reported_seq":"73","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968377+0000","last_change":"2021-01-28T04:11:15.631566+0000","last_active":"2021-01-28T04:12:20.968377+0000","last_peered":"2021-01-28T04:12:20.968377+0000","last_clean":"2021-01-28T04:12:20.968377+0000","last_became_active":"2021-01-28T04:11:15.630801+0000","last_became_peered":"2021-01-28T04:11:15.630801+0000","last_unstale":"2021-01-28T04:12:20.968377+0000","last_undegraded":"2021-01-28T04:12:20.968377+0000","last_fullsized":"2021-01-28T04:12:20.968377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":57,"num_read_kb":38,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986264+0000","last_change":"2021-01-28T04:11:17.639870+0000","last_active":"2021-01-28T04:12:20.986264+0000","last_peered":"2021-01-28T04:12:20.986264+0000","last_clean":"2021-01-28T04:12:20.986264+0000","last_became_active":"2021-01-28T04:11:17.639473+0000","last_became_peered":"2021-01-28T04:11:17.639473+0000","last_unstale":"2021-01-28T04:12:20.986264+0000","last_undegraded":"2021-01-28T04:12:20.986264+0000","last_fullsized":"2021-01-28T04:12:20.986264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987205+0000","last_change":"2021-01-28T04:11:20.677128+0000","last_active":"2021-01-28T04:12:20.987205+0000","last_peered":"2021-01-28T04:12:20.987205+0000","last_clean":"2021-01-28T04:12:20.987205+0000","last_became_active":"2021-01-28T04:11:20.676386+0000","last_became_peered":"2021-01-28T04:11:20.676386+0000","last_unstale":"2021-01-28T04:12:20.987205+0000","last_undegraded":"2021-01-28T04:12:20.987205+0000","last_fullsized":"2021-01-28T04:12:20.987205+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"34","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978873+0000","last_change":"2021-01-28T04:10:58.346125+0000","last_active":"2021-01-28T04:12:20.978873+0000","last_peered":"2021-01-28T04:12:20.978873+0000","last_clean":"2021-01-28T04:12:20.978873+0000","last_became_active":"2021-01-28T04:10:58.345120+0000","last_became_peered":"2021-01-28T04:10:58.345120+0000","last_unstale":"2021-01-28T04:12:20.978873+0000","last_undegraded":"2021-01-28T04:12:20.978873+0000","last_fullsized":"2021-01-28T04:12:20.978873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'34","reported_seq":"88","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.965588+0000","last_change":"2021-01-28T04:11:15.629794+0000","last_active":"2021-01-28T04:12:20.965588+0000","last_peered":"2021-01-28T04:12:20.965588+0000","last_clean":"2021-01-28T04:12:20.965588+0000","last_became_active":"2021-01-28T04:11:15.629367+0000","last_became_peered":"2021-01-28T04:11:15.629367+0000","last_unstale":"2021-01-28T04:12:20.965588+0000","last_undegraded":"2021-01-28T04:12:20.965588+0000","last_fullsized":"2021-01-28T04:12:20.965588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.985703+0000","last_change":"2021-01-28T04:11:17.633133+0000","last_active":"2021-01-28T04:12:20.985703+0000","last_peered":"2021-01-28T04:12:20.985703+0000","last_clean":"2021-01-28T04:12:20.985703+0000","last_became_active":"2021-01-28T04:11:17.632719+0000","last_became_peered":"2021-01-28T04:11:17.632719+0000","last_unstale":"2021-01-28T04:12:20.985703+0000","last_undegraded":"2021-01-28T04:12:20.985703+0000","last_fullsized":"2021-01-28T04:12:20.985703+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.985259+0000","last_change":"2021-01-28T04:11:20.762615+0000","last_active":"2021-01-28T04:12:20.985259+0000","last_peered":"2021-01-28T04:12:20.985259+0000","last_clean":"2021-01-28T04:12:20.985259+0000","last_became_active":"2021-01-28T04:11:20.761847+0000","last_became_peered":"2021-01-28T04:11:20.761847+0000","last_unstale":"2021-01-28T04:12:20.985259+0000","last_undegraded":"2021-01-28T04:12:20.985259+0000","last_fullsized":"2021-01-28T04:12:20.985259+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987550+0000","last_change":"2021-01-28T04:10:59.345346+0000","last_active":"2021-01-28T04:12:20.987550+0000","last_peered":"2021-01-28T04:12:20.987550+0000","last_clean":"2021-01-28T04:12:20.987550+0000","last_became_active":"2021-01-28T04:10:59.344747+0000","last_became_peered":"2021-01-28T04:10:59.344747+0000","last_unstale":"2021-01-28T04:12:20.987550+0000","last_undegraded":"2021-01-28T04:12:20.987550+0000","last_fullsized":"2021-01-28T04:12:20.987550+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"60'26","reported_seq":"65","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981337+0000","last_change":"2021-01-28T04:11:15.621067+0000","last_active":"2021-01-28T04:12:20.981337+0000","last_peered":"2021-01-28T04:12:20.981337+0000","last_clean":"2021-01-28T04:12:20.981337+0000","last_became_active":"2021-01-28T04:11:15.619844+0000","last_became_peered":"2021-01-28T04:11:15.619844+0000","last_unstale":"2021-01-28T04:12:20.981337+0000","last_undegraded":"2021-01-28T04:12:20.981337+0000","last_fullsized":"2021-01-28T04:12:20.981337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":51,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"55'2","reported_seq":"54","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.784566+0000","last_change":"2021-01-28T04:11:17.627764+0000","last_active":"2021-01-28T04:14:08.784566+0000","last_peered":"2021-01-28T04:14:08.784566+0000","last_clean":"2021-01-28T04:14:08.784566+0000","last_became_active":"2021-01-28T04:11:17.627244+0000","last_became_peered":"2021-01-28T04:11:17.627244+0000","last_unstale":"2021-01-28T04:14:08.784566+0000","last_undegraded":"2021-01-28T04:14:08.784566+0000","last_fullsized":"2021-01-28T04:14:08.784566+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967881+0000","last_change":"2021-01-28T04:11:20.762734+0000","last_active":"2021-01-28T04:12:20.967881+0000","last_peered":"2021-01-28T04:12:20.967881+0000","last_clean":"2021-01-28T04:12:20.967881+0000","last_became_active":"2021-01-28T04:11:20.761820+0000","last_became_peered":"2021-01-28T04:11:20.761820+0000","last_unstale":"2021-01-28T04:12:20.967881+0000","last_undegraded":"2021-01-28T04:12:20.967881+0000","last_fullsized":"2021-01-28T04:12:20.967881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.980551+0000","last_change":"2021-01-28T04:11:17.628909+0000","last_active":"2021-01-28T04:12:20.980551+0000","last_peered":"2021-01-28T04:12:20.980551+0000","last_clean":"2021-01-28T04:12:20.980551+0000","last_became_active":"2021-01-28T04:11:17.628138+0000","last_became_peered":"2021-01-28T04:11:17.628138+0000","last_unstale":"2021-01-28T04:12:20.980551+0000","last_undegraded":"2021-01-28T04:12:20.980551+0000","last_fullsized":"2021-01-28T04:12:20.980551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982017+0000","last_change":"2021-01-28T04:10:59.359022+0000","last_active":"2021-01-28T04:12:20.982017+0000","last_peered":"2021-01-28T04:12:20.982017+0000","last_clean":"2021-01-28T04:12:20.982017+0000","last_became_active":"2021-01-28T04:10:59.358076+0000","last_became_peered":"2021-01-28T04:10:59.358076+0000","last_unstale":"2021-01-28T04:12:20.982017+0000","last_undegraded":"2021-01-28T04:12:20.982017+0000","last_fullsized":"2021-01-28T04:12:20.982017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"60'21","reported_seq":"90","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:12:22.022671+0000","last_change":"2021-01-28T04:12:22.022671+0000","last_active":"2021-01-28T04:12:22.022671+0000","last_peered":"2021-01-28T04:12:22.022671+0000","last_clean":"2021-01-28T04:12:22.022671+0000","last_became_active":"2021-01-28T04:12:21.993811+0000","last_became_peered":"2021-01-28T04:12:21.993811+0000","last_unstale":"2021-01-28T04:12:22.022671+0000","last_undegraded":"2021-01-28T04:12:22.022671+0000","last_fullsized":"2021-01-28T04:12:22.022671+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":28,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":738,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.980229+0000","last_change":"2021-01-28T04:11:20.671937+0000","last_active":"2021-01-28T04:12:20.980229+0000","last_peered":"2021-01-28T04:12:20.980229+0000","last_clean":"2021-01-28T04:12:20.980229+0000","last_became_active":"2021-01-28T04:11:20.671509+0000","last_became_peered":"2021-01-28T04:11:20.671509+0000","last_unstale":"2021-01-28T04:12:20.980229+0000","last_undegraded":"2021-01-28T04:12:20.980229+0000","last_fullsized":"2021-01-28T04:12:20.980229+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"55'2","reported_seq":"53","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.786478+0000","last_change":"2021-01-28T04:11:17.634239+0000","last_active":"2021-01-28T04:14:08.786478+0000","last_peered":"2021-01-28T04:14:08.786478+0000","last_clean":"2021-01-28T04:14:08.786478+0000","last_became_active":"2021-01-28T04:11:17.633842+0000","last_became_peered":"2021-01-28T04:11:17.633842+0000","last_unstale":"2021-01-28T04:14:08.786478+0000","last_undegraded":"2021-01-28T04:14:08.786478+0000","last_fullsized":"2021-01-28T04:14:08.786478+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"50'1","reported_seq":"38","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976790+0000","last_change":"2021-01-28T04:10:59.351434+0000","last_active":"2021-01-28T04:12:20.976790+0000","last_peered":"2021-01-28T04:12:20.976790+0000","last_clean":"2021-01-28T04:12:20.976790+0000","last_became_active":"2021-01-28T04:10:59.350943+0000","last_became_peered":"2021-01-28T04:10:59.350943+0000","last_unstale":"2021-01-28T04:12:20.976790+0000","last_undegraded":"2021-01-28T04:12:20.976790+0000","last_fullsized":"2021-01-28T04:12:20.976790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'17","reported_seq":"46","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978820+0000","last_change":"2021-01-28T04:11:15.618449+0000","last_active":"2021-01-28T04:12:20.978820+0000","last_peered":"2021-01-28T04:12:20.978820+0000","last_clean":"2021-01-28T04:12:20.978820+0000","last_became_active":"2021-01-28T04:11:15.618022+0000","last_became_peered":"2021-01-28T04:11:15.618022+0000","last_unstale":"2021-01-28T04:12:20.978820+0000","last_undegraded":"2021-01-28T04:12:20.978820+0000","last_fullsized":"2021-01-28T04:12:20.978820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986637+0000","last_change":"2021-01-28T04:11:20.674593+0000","last_active":"2021-01-28T04:12:20.986637+0000","last_peered":"2021-01-28T04:12:20.986637+0000","last_clean":"2021-01-28T04:12:20.986637+0000","last_became_active":"2021-01-28T04:11:20.674065+0000","last_became_peered":"2021-01-28T04:11:20.674065+0000","last_unstale":"2021-01-28T04:12:20.986637+0000","last_undegraded":"2021-01-28T04:12:20.986637+0000","last_fullsized":"2021-01-28T04:12:20.986637+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:03.784828+0000","last_change":"2021-01-28T04:11:17.617328+0000","last_active":"2021-01-28T04:14:03.784828+0000","last_peered":"2021-01-28T04:14:03.784828+0000","last_clean":"2021-01-28T04:14:03.784828+0000","last_became_active":"2021-01-28T04:11:17.616919+0000","last_became_peered":"2021-01-28T04:11:17.616919+0000","last_unstale":"2021-01-28T04:14:03.784828+0000","last_undegraded":"2021-01-28T04:14:03.784828+0000","last_fullsized":"2021-01-28T04:14:03.784828+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"50'3","reported_seq":"43","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976585+0000","last_change":"2021-01-28T04:10:59.404378+0000","last_active":"2021-01-28T04:12:20.976585+0000","last_peered":"2021-01-28T04:12:20.976585+0000","last_clean":"2021-01-28T04:12:20.976585+0000","last_became_active":"2021-01-28T04:10:59.350378+0000","last_became_peered":"2021-01-28T04:10:59.350378+0000","last_unstale":"2021-01-28T04:12:20.976585+0000","last_undegraded":"2021-01-28T04:12:20.976585+0000","last_fullsized":"2021-01-28T04:12:20.976585+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":116,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'13","reported_seq":"38","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.985760+0000","last_change":"2021-01-28T04:11:15.617499+0000","last_active":"2021-01-28T04:12:20.985760+0000","last_peered":"2021-01-28T04:12:20.985760+0000","last_clean":"2021-01-28T04:12:20.985760+0000","last_became_active":"2021-01-28T04:11:15.617126+0000","last_became_peered":"2021-01-28T04:11:15.617126+0000","last_unstale":"2021-01-28T04:12:20.985760+0000","last_undegraded":"2021-01-28T04:12:20.985760+0000","last_fullsized":"2021-01-28T04:12:20.985760+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976805+0000","last_change":"2021-01-28T04:11:20.673956+0000","last_active":"2021-01-28T04:12:20.976805+0000","last_peered":"2021-01-28T04:12:20.976805+0000","last_clean":"2021-01-28T04:12:20.976805+0000","last_became_active":"2021-01-28T04:11:20.673557+0000","last_became_peered":"2021-01-28T04:11:20.673557+0000","last_unstale":"2021-01-28T04:12:20.976805+0000","last_undegraded":"2021-01-28T04:12:20.976805+0000","last_fullsized":"2021-01-28T04:12:20.976805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.977930+0000","last_change":"2021-01-28T04:11:17.625431+0000","last_active":"2021-01-28T04:12:20.977930+0000","last_peered":"2021-01-28T04:12:20.977930+0000","last_clean":"2021-01-28T04:12:20.977930+0000","last_became_active":"2021-01-28T04:11:17.625081+0000","last_became_peered":"2021-01-28T04:11:17.625081+0000","last_unstale":"2021-01-28T04:12:20.977930+0000","last_undegraded":"2021-01-28T04:12:20.977930+0000","last_fullsized":"2021-01-28T04:12:20.977930+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984667+0000","last_change":"2021-01-28T04:10:59.360986+0000","last_active":"2021-01-28T04:12:20.984667+0000","last_peered":"2021-01-28T04:12:20.984667+0000","last_clean":"2021-01-28T04:12:20.984667+0000","last_became_active":"2021-01-28T04:10:59.360542+0000","last_became_peered":"2021-01-28T04:10:59.360542+0000","last_unstale":"2021-01-28T04:12:20.984667+0000","last_undegraded":"2021-01-28T04:12:20.984667+0000","last_fullsized":"2021-01-28T04:12:20.984667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"60'21","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.988263+0000","last_change":"2021-01-28T04:11:15.620097+0000","last_active":"2021-01-28T04:12:20.988263+0000","last_peered":"2021-01-28T04:12:20.988263+0000","last_clean":"2021-01-28T04:12:20.988263+0000","last_became_active":"2021-01-28T04:11:15.619227+0000","last_became_peered":"2021-01-28T04:11:15.619227+0000","last_unstale":"2021-01-28T04:12:20.988263+0000","last_undegraded":"2021-01-28T04:12:20.988263+0000","last_fullsized":"2021-01-28T04:12:20.988263+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981645+0000","last_change":"2021-01-28T04:11:20.678936+0000","last_active":"2021-01-28T04:12:20.981645+0000","last_peered":"2021-01-28T04:12:20.981645+0000","last_clean":"2021-01-28T04:12:20.981645+0000","last_became_active":"2021-01-28T04:11:20.678284+0000","last_became_peered":"2021-01-28T04:11:20.678284+0000","last_unstale":"2021-01-28T04:12:20.981645+0000","last_undegraded":"2021-01-28T04:12:20.981645+0000","last_fullsized":"2021-01-28T04:12:20.981645+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.975767+0000","last_change":"2021-01-28T04:11:17.632051+0000","last_active":"2021-01-28T04:12:20.975767+0000","last_peered":"2021-01-28T04:12:20.975767+0000","last_clean":"2021-01-28T04:12:20.975767+0000","last_became_active":"2021-01-28T04:11:17.631547+0000","last_became_peered":"2021-01-28T04:11:17.631547+0000","last_unstale":"2021-01-28T04:12:20.975767+0000","last_undegraded":"2021-01-28T04:12:20.975767+0000","last_fullsized":"2021-01-28T04:12:20.975767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"25","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976286+0000","last_change":"2021-01-28T04:10:54.302190+0000","last_active":"2021-01-28T04:12:20.976286+0000","last_peered":"2021-01-28T04:12:20.976286+0000","last_clean":"2021-01-28T04:12:20.976286+0000","last_became_active":"2021-01-28T04:10:54.301697+0000","last_became_peered":"2021-01-28T04:10:54.301697+0000","last_unstale":"2021-01-28T04:12:20.976286+0000","last_undegraded":"2021-01-28T04:12:20.976286+0000","last_fullsized":"2021-01-28T04:12:20.976286+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'29","reported_seq":"111","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:12:22.021318+0000","last_change":"2021-01-28T04:12:22.021318+0000","last_active":"2021-01-28T04:12:22.021318+0000","last_peered":"2021-01-28T04:12:22.021318+0000","last_clean":"2021-01-28T04:12:22.021318+0000","last_became_active":"2021-01-28T04:12:21.993153+0000","last_became_peered":"2021-01-28T04:12:21.993153+0000","last_unstale":"2021-01-28T04:12:22.021318+0000","last_undegraded":"2021-01-28T04:12:22.021318+0000","last_fullsized":"2021-01-28T04:12:22.021318+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":732,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,7],"acting":[6,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966636+0000","last_change":"2021-01-28T04:11:20.670962+0000","last_active":"2021-01-28T04:12:20.966636+0000","last_peered":"2021-01-28T04:12:20.966636+0000","last_clean":"2021-01-28T04:12:20.966636+0000","last_became_active":"2021-01-28T04:11:20.670561+0000","last_became_peered":"2021-01-28T04:11:20.670561+0000","last_unstale":"2021-01-28T04:12:20.966636+0000","last_undegraded":"2021-01-28T04:12:20.966636+0000","last_fullsized":"2021-01-28T04:12:20.966636+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.975938+0000","last_change":"2021-01-28T04:11:17.633611+0000","last_active":"2021-01-28T04:12:20.975938+0000","last_peered":"2021-01-28T04:12:20.975938+0000","last_clean":"2021-01-28T04:12:20.975938+0000","last_became_active":"2021-01-28T04:11:17.633272+0000","last_became_peered":"2021-01-28T04:11:17.633272+0000","last_unstale":"2021-01-28T04:12:20.975938+0000","last_undegraded":"2021-01-28T04:12:20.975938+0000","last_fullsized":"2021-01-28T04:12:20.975938+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"50'3","reported_seq":"32","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978391+0000","last_change":"2021-01-28T04:10:54.309741+0000","last_active":"2021-01-28T04:12:20.978391+0000","last_peered":"2021-01-28T04:12:20.978391+0000","last_clean":"2021-01-28T04:12:20.978391+0000","last_became_active":"2021-01-28T04:10:54.309363+0000","last_became_peered":"2021-01-28T04:10:54.309363+0000","last_unstale":"2021-01-28T04:12:20.978391+0000","last_undegraded":"2021-01-28T04:12:20.978391+0000","last_fullsized":"2021-01-28T04:12:20.978391+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"60'20","reported_seq":"59","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.969333+0000","last_change":"2021-01-28T04:11:15.627829+0000","last_active":"2021-01-28T04:12:20.969333+0000","last_peered":"2021-01-28T04:12:20.969333+0000","last_clean":"2021-01-28T04:12:20.969333+0000","last_became_active":"2021-01-28T04:11:15.627397+0000","last_became_peered":"2021-01-28T04:11:15.627397+0000","last_unstale":"2021-01-28T04:12:20.969333+0000","last_undegraded":"2021-01-28T04:12:20.969333+0000","last_fullsized":"2021-01-28T04:12:20.969333+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":27,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978561+0000","last_change":"2021-01-28T04:11:20.761947+0000","last_active":"2021-01-28T04:12:20.978561+0000","last_peered":"2021-01-28T04:12:20.978561+0000","last_clean":"2021-01-28T04:12:20.978561+0000","last_became_active":"2021-01-28T04:11:20.761284+0000","last_became_peered":"2021-01-28T04:11:20.761284+0000","last_unstale":"2021-01-28T04:12:20.978561+0000","last_undegraded":"2021-01-28T04:12:20.978561+0000","last_fullsized":"2021-01-28T04:12:20.978561+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"43","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:12:21.990529+0000","last_change":"2021-01-28T04:12:21.990529+0000","last_active":"2021-01-28T04:12:21.990529+0000","last_peered":"2021-01-28T04:12:21.990529+0000","last_clean":"2021-01-28T04:12:21.990529+0000","last_became_active":"2021-01-28T04:12:21.990053+0000","last_became_peered":"2021-01-28T04:12:21.990053+0000","last_unstale":"2021-01-28T04:12:21.990529+0000","last_undegraded":"2021-01-28T04:12:21.990529+0000","last_fullsized":"2021-01-28T04:12:21.990529+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'30","reported_seq":"79","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978400+0000","last_change":"2021-01-28T04:11:15.627522+0000","last_active":"2021-01-28T04:12:20.978400+0000","last_peered":"2021-01-28T04:12:20.978400+0000","last_clean":"2021-01-28T04:12:20.978400+0000","last_became_active":"2021-01-28T04:11:15.627063+0000","last_became_peered":"2021-01-28T04:11:15.627063+0000","last_unstale":"2021-01-28T04:12:20.978400+0000","last_undegraded":"2021-01-28T04:12:20.978400+0000","last_fullsized":"2021-01-28T04:12:20.978400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":59,"num_read_kb":42,"num_write":31,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"55'2","reported_seq":"52","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:03.786742+0000","last_change":"2021-01-28T04:11:17.631393+0000","last_active":"2021-01-28T04:14:03.786742+0000","last_peered":"2021-01-28T04:14:03.786742+0000","last_clean":"2021-01-28T04:14:03.786742+0000","last_became_active":"2021-01-28T04:11:17.631001+0000","last_became_peered":"2021-01-28T04:11:17.631001+0000","last_unstale":"2021-01-28T04:14:03.786742+0000","last_undegraded":"2021-01-28T04:14:03.786742+0000","last_fullsized":"2021-01-28T04:14:03.786742+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":335,"num_whiteouts":0,"num_read":1452,"num_read_kb":925,"num_write":734,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2114,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":166,"num_read_kb":161,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397546,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":860160,"data_stored":292847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.968,"15min":1.9630000000000001},"min":{"1min":1.3360000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.895,"5min":3.5529999999999999,"15min":3.5529999999999999},"last":1.6299999999999999},{"interface":"front","average":{"1min":2.2679999999999998,"5min":2.2200000000000002,"15min":2.2509999999999999},"min":{"1min":1.46,"5min":0.87,"15min":0.87},"max":{"1min":3.2770000000000001,"5min":6.3659999999999997,"15min":6.3659999999999997},"last":1.5529999999999999}]},{"osd":1,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.3620000000000001,"15min":2.4239999999999999},"min":{"1min":1.288,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":3.7269999999999999,"5min":6.7050000000000001,"15min":6.7050000000000001},"last":2.1789999999999998},{"interface":"front","average":{"1min":2.2090000000000001,"5min":2.0779999999999998,"15min":2.0390000000000001},"min":{"1min":1.4179999999999999,"5min":1.03,"15min":1.03},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":2.2589999999999999}]},{"osd":2,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":2.613,"5min":2.4750000000000001,"15min":2.4430000000000001},"min":{"1min":1.3919999999999999,"5min":1.121,"15min":1.121},"max":{"1min":5.5019999999999998,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":2.5510000000000002},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.7440000000000002,"15min":2.7629999999999999},"min":{"1min":1.349,"5min":1.349,"15min":1.349},"max":{"1min":3.8149999999999999,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":3.0739999999999998}]},{"osd":3,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":2.7719999999999998,"5min":2.7389999999999999,"15min":2.7050000000000001},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.556,"5min":4.702,"15min":4.702},"last":2.9900000000000002},{"interface":"front","average":{"1min":2.8769999999999998,"5min":3.0009999999999999,"15min":3.0489999999999999},"min":{"1min":2.2749999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"max":{"1min":4.2160000000000002,"5min":5.7149999999999999,"15min":5.7149999999999999},"last":2.649}]},{"osd":4,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":2.6000000000000001,"5min":2.706,"15min":2.7719999999999998},"min":{"1min":1.175,"5min":1.175,"15min":1.175},"max":{"1min":4.6909999999999998,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":2.7410000000000001},{"interface":"front","average":{"1min":3.1190000000000002,"5min":3.2170000000000001,"15min":3.2490000000000001},"min":{"1min":1.8700000000000001,"5min":1.254,"15min":1.254},"max":{"1min":4.3150000000000004,"5min":5.6289999999999996,"15min":5.6289999999999996},"last":3.3780000000000001}]},{"osd":5,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":3.4279999999999999,"5min":3.3980000000000001,"15min":3.4329999999999998},"min":{"1min":2.427,"5min":1.2929999999999999,"15min":1.2929999999999999},"max":{"1min":4.7629999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":3.4529999999999998},{"interface":"front","average":{"1min":3.2759999999999998,"5min":3.129,"15min":3.1139999999999999},"min":{"1min":1.798,"5min":1.3460000000000001,"15min":1.3460000000000001},"max":{"1min":6.625,"5min":6.625,"15min":6.625},"last":3.1469999999999998}]},{"osd":6,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":3.298,"15min":3.2850000000000001},"min":{"1min":2.1349999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":3.5190000000000001},{"interface":"front","average":{"1min":3.4980000000000002,"5min":3.5179999999999998,"15min":3.52},"min":{"1min":2.1019999999999999,"5min":1.956,"15min":1.956},"max":{"1min":4.4029999999999996,"5min":6.6219999999999999,"15min":6.6219999999999999},"last":3.6720000000000002}]}]},{"osd":6,"up_from":41,"seq":176093659184,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6396,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738756,"statfs":{"total":95995035648,"available":95988486144,"internally_reserved":0,"allocated":905216,"data_stored":294639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.1160000000000001,"5min":1.9650000000000001,"15min":1.9570000000000001},"min":{"1min":1.492,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":3.2330000000000001,"5min":3.476,"15min":3.476},"last":2.573},{"interface":"front","average":{"1min":2.1829999999999998,"5min":2.0379999999999998,"15min":2.0099999999999998},"min":{"1min":1.615,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":2.8889999999999998}]},{"osd":1,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":2.141,"15min":2.109},"min":{"1min":1.54,"5min":1.3740000000000001,"15min":1.3740000000000001},"max":{"1min":3.0409999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":1.6519999999999999},{"interface":"front","average":{"1min":2.6829999999999998,"5min":2.3679999999999999,"15min":2.262},"min":{"1min":1.675,"5min":1.5529999999999999,"15min":1.5529999999999999},"max":{"1min":3.4489999999999998,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":2.1429999999999998}]},{"osd":2,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":2.4460000000000002,"15min":2.4260000000000002},"min":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"max":{"1min":3.2240000000000002,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":1.7390000000000001},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.6190000000000002,"15min":2.5790000000000002},"min":{"1min":1.786,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":3.6269999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":2.4460000000000002}]},{"osd":3,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":2.4649999999999999,"15min":2.4529999999999998},"min":{"1min":1.726,"5min":1.4219999999999999,"15min":1.4219999999999999},"max":{"1min":3.1200000000000001,"5min":3.601,"15min":3.601},"last":2.6629999999999998},{"interface":"front","average":{"1min":3.1099999999999999,"5min":2.944,"15min":2.9009999999999998},"min":{"1min":2.262,"5min":1.806,"15min":1.806},"max":{"1min":3.9079999999999999,"5min":3.9079999999999999,"15min":3.9079999999999999},"last":2.9590000000000001}]},{"osd":4,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.8199999999999998,"5min":2.911,"15min":2.9180000000000001},"min":{"1min":1.617,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":3.6309999999999998,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":3.891},{"interface":"front","average":{"1min":2.8610000000000002,"5min":2.9180000000000001,"15min":2.9119999999999999},"min":{"1min":2.153,"5min":1.581,"15min":1.581},"max":{"1min":3.7610000000000001,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":2.254}]},{"osd":5,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":3.3079999999999998,"5min":3.2010000000000001,"15min":3.1880000000000002},"min":{"1min":2.4660000000000002,"5min":1.4870000000000001,"15min":1.4870000000000001},"max":{"1min":3.8919999999999999,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":3.3279999999999998},{"interface":"front","average":{"1min":3.3610000000000002,"5min":3.1480000000000001,"15min":3.0920000000000001},"min":{"1min":2.0019999999999998,"5min":1.532,"15min":1.532},"max":{"1min":4.6420000000000003,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":3.036}]},{"osd":7,"last update":"Thu Jan 28 04:14:04 2021","interfaces":[{"interface":"back","average":{"1min":3.8300000000000001,"5min":3.6240000000000001,"15min":3.6019999999999999},"min":{"1min":3.2410000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"max":{"1min":5.3529999999999998,"5min":5.6539999999999999,"15min":5.6539999999999999},"last":3.6640000000000001},{"interface":"front","average":{"1min":3.722,"5min":3.5960000000000001,"15min":3.6240000000000001},"min":{"1min":3.153,"5min":1.9350000000000001,"15min":1.9350000000000001},"max":{"1min":4.4900000000000002,"5min":4.9870000000000001,"15min":4.9870000000000001},"last":3.4140000000000001}]}]},{"osd":1,"up_from":16,"seq":68719476813,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6880,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738272,"statfs":{"total":95995035648,"available":95987990528,"internally_reserved":0,"allocated":1007616,"data_stored":298861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:13:12 2021","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.7629999999999999,"15min":1.4470000000000001},"min":{"1min":1.244,"5min":0.745,"15min":0.745},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":1.772},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.893,"15min":1.583},"min":{"1min":1.264,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8559999999999999,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":2.29}]},{"osd":2,"last update":"Thu Jan 28 04:13:49 2021","interfaces":[{"interface":"back","average":{"1min":2.484,"5min":2.4049999999999998,"15min":2.1360000000000001},"min":{"1min":1.042,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.1699999999999999,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":1.673},{"interface":"front","average":{"1min":2.3330000000000002,"5min":2.3239999999999998,"15min":2.1829999999999998},"min":{"1min":1.4470000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"max":{"1min":3.0070000000000001,"5min":3.3690000000000002,"15min":3.3690000000000002},"last":1.5669999999999999}]},{"osd":3,"last update":"Thu Jan 28 04:14:09 2021","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":2.194,"15min":2.0800000000000001},"min":{"1min":1.6160000000000001,"5min":1.27,"15min":1.27},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":2.621},{"interface":"front","average":{"1min":2.823,"5min":2.621,"15min":2.419},"min":{"1min":1.6859999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.923}]},{"osd":4,"last update":"Thu Jan 28 04:13:35 2021","interfaces":[{"interface":"back","average":{"1min":2.964,"5min":2.8969999999999998,"15min":2.7549999999999999},"min":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"max":{"1min":4.673,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":2.7330000000000001},{"interface":"front","average":{"1min":3.1960000000000002,"5min":3.1219999999999999,"15min":2.9159999999999999},"min":{"1min":2.4329999999999998,"5min":2.093,"15min":2.093},"max":{"1min":4.1550000000000002,"5min":5.4779999999999998,"15min":5.4779999999999998},"last":2.23}]},{"osd":5,"last update":"Thu Jan 28 04:14:06 2021","interfaces":[{"interface":"back","average":{"1min":3.3260000000000001,"5min":3.1419999999999999,"15min":3.0299999999999998},"min":{"1min":1.617,"5min":1.617,"15min":1.617},"max":{"1min":5.2030000000000003,"5min":5.2030000000000003,"15min":5.2030000000000003},"last":3.198},{"interface":"front","average":{"1min":2.919,"5min":2.9980000000000002,"15min":2.9420000000000002},"min":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"max":{"1min":3.9460000000000002,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":3.2440000000000002}]},{"osd":6,"last update":"Thu Jan 28 04:13:35 2021","interfaces":[{"interface":"back","average":{"1min":3.4089999999999998,"5min":3.4620000000000002,"15min":3.4540000000000002},"min":{"1min":2.71,"5min":2.286,"15min":2.286},"max":{"1min":4.6130000000000004,"5min":5.7300000000000004,"15min":5.7300000000000004},"last":2.0739999999999998},{"interface":"front","average":{"1min":3.4940000000000002,"5min":3.6219999999999999,"15min":3.677},"min":{"1min":2.4079999999999999,"5min":1.859,"15min":1.859},"max":{"1min":4.968,"5min":4.968,"15min":4.968},"last":3.597}]},{"osd":7,"last update":"Thu Jan 28 04:14:06 2021","interfaces":[{"interface":"back","average":{"1min":3.3839999999999999,"5min":3.532,"15min":3.5990000000000002},"min":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"max":{"1min":4.391,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":3.6890000000000001},{"interface":"front","average":{"1min":4.0380000000000003,"5min":3.8210000000000002,"15min":3.8180000000000001},"min":{"1min":3.0760000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"max":{"1min":5.8449999999999998,"5min":5.9939999999999998,"15min":5.9939999999999998},"last":2.395}]}]},{"osd":0,"up_from":10,"seq":42949673042,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6532,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738620,"statfs":{"total":95995035648,"available":95988346880,"internally_reserved":0,"allocated":847872,"data_stored":291864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 28 04:13:18 2021","interfaces":[{"interface":"back","average":{"1min":1.982,"5min":1.7589999999999999,"15min":1.494},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":1.7969999999999999},{"interface":"front","average":{"1min":2.1629999999999998,"5min":1.867,"15min":1.5580000000000001},"min":{"1min":1.26,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":1.964}]},{"osd":2,"last update":"Thu Jan 28 04:13:46 2021","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":2.0590000000000002,"15min":1.8680000000000001},"min":{"1min":1.3759999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":5.6299999999999999,"5min":5.6299999999999999,"15min":5.6299999999999999},"last":1.919},{"interface":"front","average":{"1min":2.9980000000000002,"5min":2.6909999999999998,"15min":2.3929999999999998},"min":{"1min":1.321,"5min":1.004,"15min":1.004},"max":{"1min":5.7439999999999998,"5min":5.7439999999999998,"15min":5.7439999999999998},"last":3.3010000000000002}]},{"osd":3,"last update":"Thu Jan 28 04:14:07 2021","interfaces":[{"interface":"back","average":{"1min":2.7050000000000001,"5min":2.492,"15min":2.2280000000000002},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":5.0490000000000004,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":2.4660000000000002},{"interface":"front","average":{"1min":2.4929999999999999,"5min":2.444,"15min":2.3279999999999998},"min":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"max":{"1min":3.194,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":3.0680000000000001}]},{"osd":4,"last update":"Thu Jan 28 04:13:34 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":2.9950000000000001,"15min":2.9540000000000002},"min":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"max":{"1min":4.2069999999999999,"5min":5.476,"15min":5.476},"last":2.8359999999999999},{"interface":"front","average":{"1min":2.7669999999999999,"5min":2.8330000000000002,"15min":2.738},"min":{"1min":1.73,"5min":1.73,"15min":1.73},"max":{"1min":5.3230000000000004,"5min":5.3230000000000004,"15min":5.3230000000000004},"last":3.1779999999999999}]},{"osd":5,"last update":"Thu Jan 28 04:14:07 2021","interfaces":[{"interface":"back","average":{"1min":3.3679999999999999,"5min":3.3130000000000002,"15min":3.2610000000000001},"min":{"1min":1.885,"5min":1.885,"15min":1.885},"max":{"1min":4.798,"5min":5.452,"15min":5.452},"last":4.0259999999999998},{"interface":"front","average":{"1min":3.3380000000000001,"5min":3.2850000000000001,"15min":3.2080000000000002},"min":{"1min":2.4620000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"max":{"1min":4.8949999999999996,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":3.391}]},{"osd":6,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":3.464,"5min":3.4510000000000001,"15min":3.4289999999999998},"min":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":5.7050000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":3.484},{"interface":"front","average":{"1min":3.327,"5min":3.3889999999999998,"15min":3.367},"min":{"1min":2.198,"5min":2.198,"15min":2.198},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":3.6480000000000001}]},{"osd":7,"last update":"Thu Jan 28 04:14:07 2021","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.6019999999999999,"15min":3.6040000000000001},"min":{"1min":1.609,"5min":1.609,"15min":1.609},"max":{"1min":4.7789999999999999,"5min":5.6239999999999997,"15min":5.6239999999999997},"last":3.7330000000000001},{"interface":"front","average":{"1min":3.657,"5min":3.7160000000000002,"15min":3.7280000000000002},"min":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"max":{"1min":4.9850000000000003,"5min":5.8239999999999998,"15min":5.8239999999999998},"last":3.8149999999999999}]}]},{"osd":2,"up_from":21,"seq":90194313287,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6296,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738856,"statfs":{"total":95995035648,"available":95988588544,"internally_reserved":0,"allocated":802816,"data_stored":290567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:13:40 2021","interfaces":[{"interface":"back","average":{"1min":2.29,"5min":1.921,"15min":1.7010000000000001},"min":{"1min":1.579,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":5.2789999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":1.946},{"interface":"front","average":{"1min":2.1549999999999998,"5min":2.1930000000000001,"15min":2.028},"min":{"1min":1.627,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":3.1920000000000002,"5min":9.6590000000000007,"15min":9.6590000000000007},"last":2.0950000000000002}]},{"osd":1,"last update":"Thu Jan 28 04:13:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5169999999999999,"5min":2.278,"15min":2.04},"min":{"1min":1.825,"5min":1.121,"15min":1.121},"max":{"1min":4.6399999999999997,"5min":5.1239999999999997,"15min":5.1239999999999997},"last":2.5680000000000001},{"interface":"front","average":{"1min":2.8260000000000001,"5min":2.4369999999999998,"15min":2.1459999999999999},"min":{"1min":2.1400000000000001,"5min":1.353,"15min":1.353},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":2.8759999999999999}]},{"osd":3,"last update":"Thu Jan 28 04:13:11 2021","interfaces":[{"interface":"back","average":{"1min":2.806,"5min":2.6909999999999998,"15min":2.5609999999999999},"min":{"1min":1.9410000000000001,"5min":0.875,"15min":0.875},"max":{"1min":3.415,"5min":5.5780000000000003,"15min":5.5780000000000003},"last":2.5190000000000001},{"interface":"front","average":{"1min":2.734,"5min":2.7029999999999998,"15min":2.6030000000000002},"min":{"1min":1.885,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":6.2930000000000001,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":2.9670000000000001}]},{"osd":4,"last update":"Thu Jan 28 04:13:40 2021","interfaces":[{"interface":"back","average":{"1min":2.718,"5min":2.5630000000000002,"15min":2.5390000000000001},"min":{"1min":2.1150000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":6.0190000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":2.0369999999999999},{"interface":"front","average":{"1min":3.3999999999999999,"5min":3.0390000000000001,"15min":2.8570000000000002},"min":{"1min":2.7360000000000002,"5min":1.9119999999999999,"15min":1.9119999999999999},"max":{"1min":6.1109999999999998,"5min":6.1109999999999998,"15min":6.1109999999999998},"last":3.056}]},{"osd":5,"last update":"Thu Jan 28 04:14:06 2021","interfaces":[{"interface":"back","average":{"1min":3.3849999999999998,"5min":2.9359999999999999,"15min":2.8759999999999999},"min":{"1min":2.222,"5min":1.25,"15min":1.25},"max":{"1min":7.1900000000000004,"5min":7.1900000000000004,"15min":7.1900000000000004},"last":2.6400000000000001},{"interface":"front","average":{"1min":3.7629999999999999,"5min":3.4390000000000001,"15min":3.3029999999999999},"min":{"1min":3.1120000000000001,"5min":1.417,"15min":1.417},"max":{"1min":4.5270000000000001,"5min":6.4829999999999997,"15min":6.4829999999999997},"last":3.79}]},{"osd":6,"last update":"Thu Jan 28 04:13:35 2021","interfaces":[{"interface":"back","average":{"1min":3.7360000000000002,"5min":3.5939999999999999,"15min":3.5569999999999999},"min":{"1min":3.2040000000000002,"5min":1.121,"15min":1.121},"max":{"1min":4.5469999999999997,"5min":5.7549999999999999,"15min":5.7549999999999999},"last":4.101},{"interface":"front","average":{"1min":3.3889999999999998,"5min":3.3969999999999998,"15min":3.4350000000000001},"min":{"1min":2.5579999999999998,"5min":1.363,"15min":1.363},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":2.431}]},{"osd":7,"last update":"Thu Jan 28 04:14:06 2021","interfaces":[{"interface":"back","average":{"1min":4.0490000000000004,"5min":3.952,"15min":3.944},"min":{"1min":3.0550000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"max":{"1min":4.9390000000000001,"5min":7.3300000000000001,"15min":7.3300000000000001},"last":4.3300000000000001},{"interface":"front","average":{"1min":3.6560000000000001,"5min":3.5979999999999999,"15min":3.6440000000000001},"min":{"1min":3.0209999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"max":{"1min":5.8550000000000004,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":3.4329999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149762,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6724,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738428,"statfs":{"total":95995035648,"available":95988150272,"internally_reserved":0,"allocated":978944,"data_stored":297440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:14:09 2021","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":2.0059999999999998,"15min":1.8260000000000001},"min":{"1min":1.5980000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":4.1790000000000003,"5min":4.1790000000000003,"15min":4.1790000000000003},"last":3.129},{"interface":"front","average":{"1min":2.335,"5min":2.0800000000000001,"15min":1.9059999999999999},"min":{"1min":1.7010000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":4.5309999999999997,"5min":4.5309999999999997,"15min":4.5309999999999997},"last":2.0870000000000002}]},{"osd":1,"last update":"Thu Jan 28 04:14:09 2021","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":2.2130000000000001,"15min":2.069},"min":{"1min":1.696,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.8010000000000002,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":2.4430000000000001},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.54,"15min":2.2090000000000001},"min":{"1min":2.254,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":4.4880000000000004,"5min":4.4880000000000004,"15min":4.4880000000000004},"last":2.391}]},{"osd":2,"last update":"Thu Jan 28 04:14:09 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":2.7469999999999999,"15min":2.4870000000000001},"min":{"1min":1.853,"5min":1.3720000000000001,"15min":1.3720000000000001},"max":{"1min":4.7240000000000002,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":1.972},{"interface":"front","average":{"1min":2.5209999999999999,"5min":2.343,"15min":2.2549999999999999},"min":{"1min":2.165,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":3.968,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":2.254}]},{"osd":4,"last update":"Thu Jan 28 04:13:34 2021","interfaces":[{"interface":"back","average":{"1min":3.0369999999999999,"5min":2.8599999999999999,"15min":2.7200000000000002},"min":{"1min":1.754,"5min":1.7170000000000001,"15min":1.7170000000000001},"max":{"1min":3.8980000000000001,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":2.9889999999999999},{"interface":"front","average":{"1min":3.536,"5min":3.3319999999999999,"15min":3.1869999999999998},"min":{"1min":2.5499999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"max":{"1min":5.5309999999999997,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":3.3860000000000001}]},{"osd":5,"last update":"Thu Jan 28 04:14:04 2021","interfaces":[{"interface":"back","average":{"1min":3.2410000000000001,"5min":3.2010000000000001,"15min":3.1389999999999998},"min":{"1min":2.3660000000000001,"5min":1.472,"15min":1.472},"max":{"1min":5.202,"5min":5.202,"15min":5.202},"last":4.0270000000000001},{"interface":"front","average":{"1min":4.0659999999999998,"5min":3.7389999999999999,"15min":3.6269999999999998},"min":{"1min":3.2810000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"max":{"1min":5.1589999999999998,"5min":5.5720000000000001,"15min":5.5720000000000001},"last":3.8610000000000002}]},{"osd":6,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":3.6880000000000002,"5min":3.6339999999999999,"15min":3.5699999999999998},"min":{"1min":2.6779999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"max":{"1min":5.1219999999999999,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":3.5979999999999999},{"interface":"front","average":{"1min":3.069,"5min":2.8839999999999999,"15min":2.8039999999999998},"min":{"1min":1.9650000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"max":{"1min":4.3520000000000003,"5min":5.2290000000000001,"15min":5.2290000000000001},"last":2.7879999999999998}]},{"osd":7,"last update":"Thu Jan 28 04:14:04 2021","interfaces":[{"interface":"back","average":{"1min":4.3310000000000004,"5min":4.0279999999999996,"15min":3.9420000000000002},"min":{"1min":3.4940000000000002,"5min":2.1360000000000001,"15min":2.1360000000000001},"max":{"1min":5.5309999999999997,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":4.2089999999999996},{"interface":"front","average":{"1min":3.4140000000000001,"5min":3.2389999999999999,"15min":3.2000000000000002},"min":{"1min":2.5619999999999998,"5min":1.413,"15min":1.413},"max":{"1min":4.3369999999999997,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":3.222}]}]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6544,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738608,"statfs":{"total":95995035648,"available":95988334592,"internally_reserved":0,"allocated":925696,"data_stored":294979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":1.984,"5min":1.984,"15min":1.9299999999999999},"min":{"1min":1.4770000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":2.694,"5min":5.9269999999999996,"15min":5.9269999999999996},"last":1.986},{"interface":"front","average":{"1min":2.0840000000000001,"5min":2.0859999999999999,"15min":2.1400000000000001},"min":{"1min":1.5069999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":3.214,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":2.1040000000000001}]},{"osd":1,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":2.1080000000000001,"5min":2.0590000000000002,"15min":2.0150000000000001},"min":{"1min":1.538,"5min":1.3080000000000001,"15min":1.3080000000000001},"max":{"1min":3.0299999999999998,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":2.2280000000000002},{"interface":"front","average":{"1min":2.585,"5min":2.3879999999999999,"15min":2.2320000000000002},"min":{"1min":1.6100000000000001,"5min":1.498,"15min":1.498},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.581}]},{"osd":2,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":2.536,"5min":2.5430000000000001,"15min":2.367},"min":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"max":{"1min":4.1500000000000004,"5min":4.8869999999999996,"15min":4.8869999999999996},"last":3.141},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.6080000000000001,"15min":2.4129999999999998},"min":{"1min":1.73,"5min":1.177,"15min":1.177},"max":{"1min":3.6219999999999999,"5min":4.734,"15min":4.734},"last":3.8260000000000001}]},{"osd":3,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":2.9500000000000002,"5min":2.7879999999999998,"15min":2.6920000000000002},"min":{"1min":2.5600000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.319,"5min":5.1710000000000003,"15min":5.1710000000000003},"last":4.1269999999999998},{"interface":"front","average":{"1min":2.7970000000000002,"5min":2.6949999999999998,"15min":2.54},"min":{"1min":2.1629999999999998,"5min":1.546,"15min":1.546},"max":{"1min":3.5910000000000002,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":3.3279999999999998}]},{"osd":5,"last update":"Thu Jan 28 04:14:14 2021","interfaces":[{"interface":"back","average":{"1min":2.8839999999999999,"5min":2.8300000000000001,"15min":2.7170000000000001},"min":{"1min":2.0739999999999998,"5min":1.304,"15min":1.304},"max":{"1min":4.3239999999999998,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":4.3239999999999998},{"interface":"front","average":{"1min":2.931,"5min":3.0150000000000001,"15min":2.8610000000000002},"min":{"1min":1.911,"5min":1.113,"15min":1.113},"max":{"1min":3.5680000000000001,"5min":5.125,"15min":5.125},"last":3.5680000000000001}]},{"osd":6,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":3.2519999999999998,"5min":3.4180000000000001,"15min":3.476},"min":{"1min":2.3580000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"max":{"1min":4.0670000000000002,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":4.4109999999999996},{"interface":"front","average":{"1min":3.4300000000000002,"5min":3.46,"15min":3.4540000000000002},"min":{"1min":2.3010000000000002,"5min":2.0699999999999998,"15min":2.0699999999999998},"max":{"1min":4.2439999999999998,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":4.5650000000000004}]},{"osd":7,"last update":"Thu Jan 28 04:14:00 2021","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.7930000000000001,"15min":3.8839999999999999},"min":{"1min":2.5590000000000002,"5min":2.4929999999999999,"15min":2.4929999999999999},"max":{"1min":4.4770000000000003,"5min":7.0979999999999999,"15min":7.0979999999999999},"last":4.7789999999999999},{"interface":"front","average":{"1min":3.5510000000000002,"5min":3.7269999999999999,"15min":3.827},"min":{"1min":2.867,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.2000000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":4.617}]}]},{"osd":5,"up_from":36,"seq":154618822710,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6304,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738848,"statfs":{"total":95995035648,"available":95988580352,"internally_reserved":0,"allocated":811008,"data_stored":290641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":2.0019999999999998,"5min":1.972,"15min":1.996},"min":{"1min":1.429,"5min":1.163,"15min":1.163},"max":{"1min":2.7749999999999999,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":3.004},{"interface":"front","average":{"1min":2.1819999999999999,"5min":2.0270000000000001,"15min":1.9039999999999999},"min":{"1min":1.5660000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"max":{"1min":4.0510000000000002,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":1.8740000000000001}]},{"osd":1,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":2.0259999999999998,"15min":1.956},"min":{"1min":1.464,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":3.391,"5min":3.391,"15min":3.391},"last":2.1960000000000002},{"interface":"front","average":{"1min":2.238,"5min":2.2120000000000002,"15min":2.0649999999999999},"min":{"1min":1.429,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.306,"5min":4.9249999999999998,"15min":4.9249999999999998},"last":1.4410000000000001}]},{"osd":2,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":2.5899999999999999,"5min":2.5,"15min":2.2799999999999998},"min":{"1min":1.7050000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"max":{"1min":3.5750000000000002,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":1.5589999999999999},{"interface":"front","average":{"1min":2.589,"5min":2.456,"15min":2.2989999999999999},"min":{"1min":1.857,"5min":1.3779999999999999,"15min":1.3779999999999999},"max":{"1min":3.7669999999999999,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":2.448}]},{"osd":3,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":3.0419999999999998,"5min":2.9089999999999998,"15min":2.681},"min":{"1min":1.379,"5min":1.379,"15min":1.379},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":3.6309999999999998},{"interface":"front","average":{"1min":3.0790000000000002,"5min":2.9910000000000001,"15min":2.7890000000000001},"min":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":4.1689999999999996,"5min":5.0659999999999998,"15min":5.0659999999999998},"last":3.3109999999999999}]},{"osd":4,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":2.7949999999999999,"5min":2.6749999999999998,"15min":2.468},"min":{"1min":1.9490000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.7389999999999999,"5min":5.3049999999999997,"15min":5.3049999999999997},"last":2.2610000000000001},{"interface":"front","average":{"1min":3.3450000000000002,"5min":3.0990000000000002,"15min":2.7999999999999998},"min":{"1min":2.056,"5min":1.4379999999999999,"15min":1.4379999999999999},"max":{"1min":5.3079999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":3.3940000000000001}]},{"osd":6,"last update":"Thu Jan 28 04:13:31 2021","interfaces":[{"interface":"back","average":{"1min":3.4369999999999998,"5min":3.3530000000000002,"15min":3.2549999999999999},"min":{"1min":2.2629999999999999,"5min":1.772,"15min":1.772},"max":{"1min":4.5209999999999999,"5min":5.2439999999999998,"15min":5.2439999999999998},"last":4.0380000000000003},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.1850000000000001,"15min":3.125},"min":{"1min":2.6150000000000002,"5min":1.5960000000000001,"15min":1.5960000000000001},"max":{"1min":3.899,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":2.944}]},{"osd":7,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.968,"15min":4.0679999999999996},"min":{"1min":3.2109999999999999,"5min":2.552,"15min":2.552},"max":{"1min":5.1970000000000001,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":3.835},{"interface":"front","average":{"1min":3.4649999999999999,"5min":3.6150000000000002,"15min":3.6739999999999999},"min":{"1min":2.1560000000000001,"5min":1.1359999999999999,"15min":1.1359999999999999},"max":{"1min":4.6070000000000002,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":3.673}]}]}]}} 2021-01-28T04:14:17.125 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph pg dump --format=json 2021-01-28T04:14:17.281 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:14:17.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:17 smithi150 bash[9867]: audit 2021-01-28T04:14:16.352381+0000 mgr.y (mgr.14138) 449 : audit [DBG] from='client.24658 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T04:14:17.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:17 smithi150 bash[9867]: cluster 2021-01-28T04:14:16.955473+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:17.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:17 smithi150 bash[13629]: audit 2021-01-28T04:14:16.352381+0000 mgr.y (mgr.14138) 449 : audit [DBG] from='client.24658 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T04:14:17.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:17 smithi150 bash[13629]: cluster 2021-01-28T04:14:16.955473+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:18.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:17 smithi134 bash[9858]: audit 2021-01-28T04:14:16.352381+0000 mgr.y (mgr.14138) 449 : audit [DBG] from='client.24658 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T04:14:18.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:17 smithi134 bash[9858]: cluster 2021-01-28T04:14:16.955473+0000 mgr.y (mgr.14138) 450 : cluster [DBG] pgmap v320: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:19.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:19 smithi134 bash[9858]: cluster 2021-01-28T04:14:18.956848+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:19.410 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:19 smithi150 bash[9867]: cluster 2021-01-28T04:14:18.956848+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:19.411 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:19 smithi150 bash[13629]: cluster 2021-01-28T04:14:18.956848+0000 mgr.y (mgr.14138) 451 : cluster [DBG] pgmap v321: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:20.860 INFO:teuthology.orchestra.run.smithi150.stdout: 2021-01-28T04:14:20.871 INFO:teuthology.orchestra.run.smithi150.stderr:dumped all 2021-01-28T04:14:21.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[9867]: audit 2021-01-28T04:14:20.836656+0000 mgr.y (mgr.14138) 452 : audit [DBG] from='client.24664 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T04:14:21.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[9867]: cluster 2021-01-28T04:14:20.957730+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:21.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[9867]: audit 2021-01-28T04:14:20.997545+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:14:21.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[9867]: audit 2021-01-28T04:14:20.998018+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:14:21.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[13629]: audit 2021-01-28T04:14:20.836656+0000 mgr.y (mgr.14138) 452 : audit [DBG] from='client.24664 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T04:14:21.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[13629]: cluster 2021-01-28T04:14:20.957730+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:21.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[13629]: audit 2021-01-28T04:14:20.997545+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:14:21.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[13629]: audit 2021-01-28T04:14:20.998018+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:14:21.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:21 smithi134 bash[9858]: audit 2021-01-28T04:14:20.836656+0000 mgr.y (mgr.14138) 452 : audit [DBG] from='client.24664 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2021-01-28T04:14:21.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:21 smithi134 bash[9858]: cluster 2021-01-28T04:14:20.957730+0000 mgr.y (mgr.14138) 453 : cluster [DBG] pgmap v322: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:21.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:21 smithi134 bash[9858]: audit 2021-01-28T04:14:20.997545+0000 mon.a (mon.0) 652 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:14:21.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:21 smithi134 bash[9858]: audit 2021-01-28T04:14:20.998018+0000 mon.a (mon.0) 653 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:14:21.611 INFO:teuthology.orchestra.run.smithi150.stdout:{"pg_ready":true,"pg_map":{"version":321,"stamp":"2021-01-28T04:14:18.955794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25858,"num_objects":357,"num_object_clones":0,"num_object_copies":1071,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":357,"num_whiteouts":0,"num_read":1650,"num_read_kb":1118,"num_write":759,"num_write_kb":177,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":2286,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":742,"ondisk_log_size":742,"up":396,"acting":396,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":396,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":749961216,"kb_used":51964,"kb_used_data":6972,"kb_used_omap":0,"kb_used_meta":44928,"kb_avail":749909252,"statfs":{"total":767960285184,"available":767907074048,"internally_reserved":0,"allocated":7139328,"data_stored":2351838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46006272},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006275"},"pg_stats":[{"pgid":"6.1b","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967059+0000","last_change":"2021-01-28T04:11:20.766600+0000","last_active":"2021-01-28T04:12:20.967059+0000","last_peered":"2021-01-28T04:12:20.967059+0000","last_clean":"2021-01-28T04:12:20.967059+0000","last_became_active":"2021-01-28T04:11:20.765858+0000","last_became_peered":"2021-01-28T04:11:20.765858+0000","last_unstale":"2021-01-28T04:12:20.967059+0000","last_undegraded":"2021-01-28T04:12:20.967059+0000","last_fullsized":"2021-01-28T04:12:20.967059+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982775+0000","last_change":"2021-01-28T04:11:17.639617+0000","last_active":"2021-01-28T04:12:20.982775+0000","last_peered":"2021-01-28T04:12:20.982775+0000","last_clean":"2021-01-28T04:12:20.982775+0000","last_became_active":"2021-01-28T04:11:17.639183+0000","last_became_peered":"2021-01-28T04:11:17.639183+0000","last_unstale":"2021-01-28T04:12:20.982775+0000","last_undegraded":"2021-01-28T04:12:20.982775+0000","last_fullsized":"2021-01-28T04:12:20.982775+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968713+0000","last_change":"2021-01-28T04:10:59.362859+0000","last_active":"2021-01-28T04:12:20.968713+0000","last_peered":"2021-01-28T04:12:20.968713+0000","last_clean":"2021-01-28T04:12:20.968713+0000","last_became_active":"2021-01-28T04:10:59.362335+0000","last_became_peered":"2021-01-28T04:10:59.362335+0000","last_unstale":"2021-01-28T04:12:20.968713+0000","last_undegraded":"2021-01-28T04:12:20.968713+0000","last_fullsized":"2021-01-28T04:12:20.968713+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,4],"acting":[0,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"60'44","reported_seq":"113","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966735+0000","last_change":"2021-01-28T04:11:15.626538+0000","last_active":"2021-01-28T04:12:20.966735+0000","last_peered":"2021-01-28T04:12:20.966735+0000","last_clean":"2021-01-28T04:12:20.966735+0000","last_became_active":"2021-01-28T04:11:15.625676+0000","last_became_peered":"2021-01-28T04:11:15.625676+0000","last_unstale":"2021-01-28T04:12:20.966735+0000","last_undegraded":"2021-01-28T04:12:20.966735+0000","last_fullsized":"2021-01-28T04:12:20.966735+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":44,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":890,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":89,"num_read_kb":66,"num_write":45,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986123+0000","last_change":"2021-01-28T04:11:20.676805+0000","last_active":"2021-01-28T04:12:20.986123+0000","last_peered":"2021-01-28T04:12:20.986123+0000","last_clean":"2021-01-28T04:12:20.986123+0000","last_became_active":"2021-01-28T04:11:20.675726+0000","last_became_peered":"2021-01-28T04:11:20.675726+0000","last_unstale":"2021-01-28T04:12:20.986123+0000","last_undegraded":"2021-01-28T04:12:20.986123+0000","last_fullsized":"2021-01-28T04:12:20.986123+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,1],"acting":[4,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976685+0000","last_change":"2021-01-28T04:11:17.618047+0000","last_active":"2021-01-28T04:12:20.976685+0000","last_peered":"2021-01-28T04:12:20.976685+0000","last_clean":"2021-01-28T04:12:20.976685+0000","last_became_active":"2021-01-28T04:11:17.617474+0000","last_became_peered":"2021-01-28T04:11:17.617474+0000","last_unstale":"2021-01-28T04:12:20.976685+0000","last_undegraded":"2021-01-28T04:12:20.976685+0000","last_fullsized":"2021-01-28T04:12:20.976685+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7],"acting":[1,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.971488+0000","last_change":"2021-01-28T04:10:54.295095+0000","last_active":"2021-01-28T04:12:20.971488+0000","last_peered":"2021-01-28T04:12:20.971488+0000","last_clean":"2021-01-28T04:12:20.971488+0000","last_became_active":"2021-01-28T04:10:54.294535+0000","last_became_peered":"2021-01-28T04:10:54.294535+0000","last_unstale":"2021-01-28T04:12:20.971488+0000","last_undegraded":"2021-01-28T04:12:20.971488+0000","last_fullsized":"2021-01-28T04:12:20.971488+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"60'21","reported_seq":"60","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982105+0000","last_change":"2021-01-28T04:11:15.616744+0000","last_active":"2021-01-28T04:12:20.982105+0000","last_peered":"2021-01-28T04:12:20.982105+0000","last_clean":"2021-01-28T04:12:20.982105+0000","last_became_active":"2021-01-28T04:11:15.615747+0000","last_became_peered":"2021-01-28T04:11:15.615747+0000","last_unstale":"2021-01-28T04:12:20.982105+0000","last_undegraded":"2021-01-28T04:12:20.982105+0000","last_fullsized":"2021-01-28T04:12:20.982105+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1038,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":47,"num_read_kb":28,"num_write":22,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978212+0000","last_change":"2021-01-28T04:11:20.674672+0000","last_active":"2021-01-28T04:12:20.978212+0000","last_peered":"2021-01-28T04:12:20.978212+0000","last_clean":"2021-01-28T04:12:20.978212+0000","last_became_active":"2021-01-28T04:11:20.674292+0000","last_became_peered":"2021-01-28T04:11:20.674292+0000","last_unstale":"2021-01-28T04:12:20.978212+0000","last_undegraded":"2021-01-28T04:12:20.978212+0000","last_fullsized":"2021-01-28T04:12:20.978212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,3],"acting":[5,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984009+0000","last_change":"2021-01-28T04:11:17.633230+0000","last_active":"2021-01-28T04:12:20.984009+0000","last_peered":"2021-01-28T04:12:20.984009+0000","last_clean":"2021-01-28T04:12:20.984009+0000","last_became_active":"2021-01-28T04:11:17.632495+0000","last_became_peered":"2021-01-28T04:11:17.632495+0000","last_unstale":"2021-01-28T04:12:20.984009+0000","last_undegraded":"2021-01-28T04:12:20.984009+0000","last_fullsized":"2021-01-28T04:12:20.984009+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982446+0000","last_change":"2021-01-28T04:10:59.357670+0000","last_active":"2021-01-28T04:12:20.982446+0000","last_peered":"2021-01-28T04:12:20.982446+0000","last_clean":"2021-01-28T04:12:20.982446+0000","last_became_active":"2021-01-28T04:10:59.357150+0000","last_became_peered":"2021-01-28T04:10:59.357150+0000","last_unstale":"2021-01-28T04:12:20.982446+0000","last_undegraded":"2021-01-28T04:12:20.982446+0000","last_fullsized":"2021-01-28T04:12:20.982446+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"60'12","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987453+0000","last_change":"2021-01-28T04:11:15.614366+0000","last_active":"2021-01-28T04:12:20.987453+0000","last_peered":"2021-01-28T04:12:20.987453+0000","last_clean":"2021-01-28T04:12:20.987453+0000","last_became_active":"2021-01-28T04:11:15.613914+0000","last_became_peered":"2021-01-28T04:11:15.613914+0000","last_unstale":"2021-01-28T04:12:20.987453+0000","last_undegraded":"2021-01-28T04:12:20.987453+0000","last_fullsized":"2021-01-28T04:12:20.987453+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":264,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":13,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,1],"acting":[4,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967067+0000","last_change":"2021-01-28T04:11:20.677013+0000","last_active":"2021-01-28T04:12:20.967067+0000","last_peered":"2021-01-28T04:12:20.967067+0000","last_clean":"2021-01-28T04:12:20.967067+0000","last_became_active":"2021-01-28T04:11:20.676371+0000","last_became_peered":"2021-01-28T04:11:20.676371+0000","last_unstale":"2021-01-28T04:12:20.967067+0000","last_undegraded":"2021-01-28T04:12:20.967067+0000","last_fullsized":"2021-01-28T04:12:20.967067+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.979285+0000","last_change":"2021-01-28T04:11:17.624098+0000","last_active":"2021-01-28T04:12:20.979285+0000","last_peered":"2021-01-28T04:12:20.979285+0000","last_clean":"2021-01-28T04:12:20.979285+0000","last_became_active":"2021-01-28T04:11:17.623603+0000","last_became_peered":"2021-01-28T04:11:17.623603+0000","last_unstale":"2021-01-28T04:12:20.979285+0000","last_undegraded":"2021-01-28T04:12:20.979285+0000","last_fullsized":"2021-01-28T04:12:20.979285+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,7],"acting":[5,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.983704+0000","last_change":"2021-01-28T04:10:59.358847+0000","last_active":"2021-01-28T04:12:20.983704+0000","last_peered":"2021-01-28T04:12:20.983704+0000","last_clean":"2021-01-28T04:12:20.983704+0000","last_became_active":"2021-01-28T04:10:59.358007+0000","last_became_peered":"2021-01-28T04:10:59.358007+0000","last_unstale":"2021-01-28T04:12:20.983704+0000","last_undegraded":"2021-01-28T04:12:20.983704+0000","last_fullsized":"2021-01-28T04:12:20.983704+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"60'25","reported_seq":"71","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986367+0000","last_change":"2021-01-28T04:11:15.618015+0000","last_active":"2021-01-28T04:12:20.986367+0000","last_peered":"2021-01-28T04:12:20.986367+0000","last_clean":"2021-01-28T04:12:20.986367+0000","last_became_active":"2021-01-28T04:11:15.617664+0000","last_became_peered":"2021-01-28T04:11:15.617664+0000","last_unstale":"2021-01-28T04:12:20.986367+0000","last_undegraded":"2021-01-28T04:12:20.986367+0000","last_fullsized":"2021-01-28T04:12:20.986367+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":25,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.970732+0000","last_change":"2021-01-28T04:11:20.762627+0000","last_active":"2021-01-28T04:12:20.970732+0000","last_peered":"2021-01-28T04:12:20.970732+0000","last_clean":"2021-01-28T04:12:20.970732+0000","last_became_active":"2021-01-28T04:11:20.761886+0000","last_became_peered":"2021-01-28T04:11:20.761886+0000","last_unstale":"2021-01-28T04:12:20.970732+0000","last_undegraded":"2021-01-28T04:12:20.970732+0000","last_fullsized":"2021-01-28T04:12:20.970732+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986187+0000","last_change":"2021-01-28T04:11:17.633281+0000","last_active":"2021-01-28T04:12:20.986187+0000","last_peered":"2021-01-28T04:12:20.986187+0000","last_clean":"2021-01-28T04:12:20.986187+0000","last_became_active":"2021-01-28T04:11:17.632888+0000","last_became_peered":"2021-01-28T04:11:17.632888+0000","last_unstale":"2021-01-28T04:12:20.986187+0000","last_undegraded":"2021-01-28T04:12:20.986187+0000","last_fullsized":"2021-01-28T04:12:20.986187+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967169+0000","last_change":"2021-01-28T04:10:59.354291+0000","last_active":"2021-01-28T04:12:20.967169+0000","last_peered":"2021-01-28T04:12:20.967169+0000","last_clean":"2021-01-28T04:12:20.967169+0000","last_became_active":"2021-01-28T04:10:59.353807+0000","last_became_peered":"2021-01-28T04:10:59.353807+0000","last_unstale":"2021-01-28T04:12:20.967169+0000","last_undegraded":"2021-01-28T04:12:20.967169+0000","last_fullsized":"2021-01-28T04:12:20.967169+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"60'22","reported_seq":"64","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.970320+0000","last_change":"2021-01-28T04:11:15.613848+0000","last_active":"2021-01-28T04:12:20.970320+0000","last_peered":"2021-01-28T04:12:20.970320+0000","last_clean":"2021-01-28T04:12:20.970320+0000","last_became_active":"2021-01-28T04:11:15.613184+0000","last_became_peered":"2021-01-28T04:11:15.613184+0000","last_unstale":"2021-01-28T04:12:20.970320+0000","last_undegraded":"2021-01-28T04:12:20.970320+0000","last_fullsized":"2021-01-28T04:12:20.970320+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":844,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":49,"num_read_kb":31,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986339+0000","last_change":"2021-01-28T04:11:20.763668+0000","last_active":"2021-01-28T04:12:20.986339+0000","last_peered":"2021-01-28T04:12:20.986339+0000","last_clean":"2021-01-28T04:12:20.986339+0000","last_became_active":"2021-01-28T04:11:20.762673+0000","last_became_peered":"2021-01-28T04:11:20.762673+0000","last_unstale":"2021-01-28T04:12:20.986339+0000","last_undegraded":"2021-01-28T04:12:20.986339+0000","last_fullsized":"2021-01-28T04:12:20.986339+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978624+0000","last_change":"2021-01-28T04:11:17.631774+0000","last_active":"2021-01-28T04:12:20.978624+0000","last_peered":"2021-01-28T04:12:20.978624+0000","last_clean":"2021-01-28T04:12:20.978624+0000","last_became_active":"2021-01-28T04:11:17.631181+0000","last_became_peered":"2021-01-28T04:11:17.631181+0000","last_unstale":"2021-01-28T04:12:20.978624+0000","last_undegraded":"2021-01-28T04:12:20.978624+0000","last_fullsized":"2021-01-28T04:12:20.978624+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986150+0000","last_change":"2021-01-28T04:10:59.344847+0000","last_active":"2021-01-28T04:12:20.986150+0000","last_peered":"2021-01-28T04:12:20.986150+0000","last_clean":"2021-01-28T04:12:20.986150+0000","last_became_active":"2021-01-28T04:10:59.344431+0000","last_became_peered":"2021-01-28T04:10:59.344431+0000","last_unstale":"2021-01-28T04:12:20.986150+0000","last_undegraded":"2021-01-28T04:12:20.986150+0000","last_fullsized":"2021-01-28T04:12:20.986150+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1c","version":"60'15","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976462+0000","last_change":"2021-01-28T04:11:15.612609+0000","last_active":"2021-01-28T04:12:20.976462+0000","last_peered":"2021-01-28T04:12:20.976462+0000","last_clean":"2021-01-28T04:12:20.976462+0000","last_became_active":"2021-01-28T04:11:15.612195+0000","last_became_peered":"2021-01-28T04:11:15.612195+0000","last_unstale":"2021-01-28T04:12:20.976462+0000","last_undegraded":"2021-01-28T04:12:20.976462+0000","last_fullsized":"2021-01-28T04:12:20.976462+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3],"acting":[2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978212+0000","last_change":"2021-01-28T04:11:20.671893+0000","last_active":"2021-01-28T04:12:20.978212+0000","last_peered":"2021-01-28T04:12:20.978212+0000","last_clean":"2021-01-28T04:12:20.978212+0000","last_became_active":"2021-01-28T04:11:20.671368+0000","last_became_peered":"2021-01-28T04:11:20.671368+0000","last_unstale":"2021-01-28T04:12:20.978212+0000","last_undegraded":"2021-01-28T04:12:20.978212+0000","last_fullsized":"2021-01-28T04:12:20.978212+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968612+0000","last_change":"2021-01-28T04:11:17.639061+0000","last_active":"2021-01-28T04:12:20.968612+0000","last_peered":"2021-01-28T04:12:20.968612+0000","last_clean":"2021-01-28T04:12:20.968612+0000","last_became_active":"2021-01-28T04:11:17.638706+0000","last_became_peered":"2021-01-28T04:11:17.638706+0000","last_unstale":"2021-01-28T04:12:20.968612+0000","last_undegraded":"2021-01-28T04:12:20.968612+0000","last_fullsized":"2021-01-28T04:12:20.968612+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966370+0000","last_change":"2021-01-28T04:10:54.288994+0000","last_active":"2021-01-28T04:12:20.966370+0000","last_peered":"2021-01-28T04:12:20.966370+0000","last_clean":"2021-01-28T04:12:20.966370+0000","last_became_active":"2021-01-28T04:10:54.288565+0000","last_became_peered":"2021-01-28T04:10:54.288565+0000","last_unstale":"2021-01-28T04:12:20.966370+0000","last_undegraded":"2021-01-28T04:12:20.966370+0000","last_fullsized":"2021-01-28T04:12:20.966370+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,0],"acting":[3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"60'23","reported_seq":"64","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987206+0000","last_change":"2021-01-28T04:11:15.613962+0000","last_active":"2021-01-28T04:12:20.987206+0000","last_peered":"2021-01-28T04:12:20.987206+0000","last_clean":"2021-01-28T04:12:20.987206+0000","last_became_active":"2021-01-28T04:11:15.613539+0000","last_became_peered":"2021-01-28T04:11:15.613539+0000","last_unstale":"2021-01-28T04:12:20.987206+0000","last_undegraded":"2021-01-28T04:12:20.987206+0000","last_fullsized":"2021-01-28T04:12:20.987206+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":23,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":50,"num_read_kb":30,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1],"acting":[6,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984617+0000","last_change":"2021-01-28T04:11:20.668683+0000","last_active":"2021-01-28T04:12:20.984617+0000","last_peered":"2021-01-28T04:12:20.984617+0000","last_clean":"2021-01-28T04:12:20.984617+0000","last_became_active":"2021-01-28T04:11:20.667602+0000","last_became_peered":"2021-01-28T04:11:20.667602+0000","last_unstale":"2021-01-28T04:12:20.984617+0000","last_undegraded":"2021-01-28T04:12:20.984617+0000","last_fullsized":"2021-01-28T04:12:20.984617+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,2],"acting":[7,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"55'2","reported_seq":"54","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.786396+0000","last_change":"2021-01-28T04:11:17.628353+0000","last_active":"2021-01-28T04:14:08.786396+0000","last_peered":"2021-01-28T04:14:08.786396+0000","last_clean":"2021-01-28T04:14:08.786396+0000","last_became_active":"2021-01-28T04:11:17.627880+0000","last_became_peered":"2021-01-28T04:11:17.627880+0000","last_unstale":"2021-01-28T04:14:08.786396+0000","last_undegraded":"2021-01-28T04:14:08.786396+0000","last_fullsized":"2021-01-28T04:14:08.786396+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978143+0000","last_change":"2021-01-28T04:10:59.352408+0000","last_active":"2021-01-28T04:12:20.978143+0000","last_peered":"2021-01-28T04:12:20.978143+0000","last_clean":"2021-01-28T04:12:20.978143+0000","last_became_active":"2021-01-28T04:10:59.351956+0000","last_became_peered":"2021-01-28T04:10:59.351956+0000","last_unstale":"2021-01-28T04:12:20.978143+0000","last_undegraded":"2021-01-28T04:12:20.978143+0000","last_fullsized":"2021-01-28T04:12:20.978143+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"60'22","reported_seq":"60","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968536+0000","last_change":"2021-01-28T04:11:15.630576+0000","last_active":"2021-01-28T04:12:20.968536+0000","last_peered":"2021-01-28T04:12:20.968536+0000","last_clean":"2021-01-28T04:12:20.968536+0000","last_became_active":"2021-01-28T04:11:15.630203+0000","last_became_peered":"2021-01-28T04:11:15.630203+0000","last_unstale":"2021-01-28T04:12:20.968536+0000","last_undegraded":"2021-01-28T04:12:20.968536+0000","last_fullsized":"2021-01-28T04:12:20.968536+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":934,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967660+0000","last_change":"2021-01-28T04:11:20.764030+0000","last_active":"2021-01-28T04:12:20.967660+0000","last_peered":"2021-01-28T04:12:20.967660+0000","last_clean":"2021-01-28T04:12:20.967660+0000","last_became_active":"2021-01-28T04:11:20.763048+0000","last_became_peered":"2021-01-28T04:11:20.763048+0000","last_unstale":"2021-01-28T04:12:20.967660+0000","last_undegraded":"2021-01-28T04:12:20.967660+0000","last_fullsized":"2021-01-28T04:12:20.967660+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982437+0000","last_change":"2021-01-28T04:11:17.623468+0000","last_active":"2021-01-28T04:12:20.982437+0000","last_peered":"2021-01-28T04:12:20.982437+0000","last_clean":"2021-01-28T04:12:20.982437+0000","last_became_active":"2021-01-28T04:11:17.623054+0000","last_became_peered":"2021-01-28T04:11:17.623054+0000","last_unstale":"2021-01-28T04:12:20.982437+0000","last_undegraded":"2021-01-28T04:12:20.982437+0000","last_fullsized":"2021-01-28T04:12:20.982437+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.17","version":"45'1","reported_seq":"30","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987330+0000","last_change":"2021-01-28T04:10:58.352209+0000","last_active":"2021-01-28T04:12:20.987330+0000","last_peered":"2021-01-28T04:12:20.987330+0000","last_clean":"2021-01-28T04:12:20.987330+0000","last_became_active":"2021-01-28T04:10:58.343247+0000","last_became_peered":"2021-01-28T04:10:58.343247+0000","last_unstale":"2021-01-28T04:12:20.987330+0000","last_undegraded":"2021-01-28T04:12:20.987330+0000","last_fullsized":"2021-01-28T04:12:20.987330+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,2],"acting":[6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"60'20","reported_seq":"58","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966690+0000","last_change":"2021-01-28T04:11:15.630454+0000","last_active":"2021-01-28T04:12:20.966690+0000","last_peered":"2021-01-28T04:12:20.966690+0000","last_clean":"2021-01-28T04:12:20.966690+0000","last_became_active":"2021-01-28T04:11:15.628560+0000","last_became_peered":"2021-01-28T04:11:15.628560+0000","last_unstale":"2021-01-28T04:12:20.966690+0000","last_undegraded":"2021-01-28T04:12:20.966690+0000","last_fullsized":"2021-01-28T04:12:20.966690+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":580,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":27,"num_write":21,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982154+0000","last_change":"2021-01-28T04:11:20.670169+0000","last_active":"2021-01-28T04:12:20.982154+0000","last_peered":"2021-01-28T04:12:20.982154+0000","last_clean":"2021-01-28T04:12:20.982154+0000","last_became_active":"2021-01-28T04:11:20.668869+0000","last_became_peered":"2021-01-28T04:11:20.668869+0000","last_unstale":"2021-01-28T04:12:20.982154+0000","last_undegraded":"2021-01-28T04:12:20.982154+0000","last_fullsized":"2021-01-28T04:12:20.982154+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,4],"acting":[7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984325+0000","last_change":"2021-01-28T04:11:17.629615+0000","last_active":"2021-01-28T04:12:20.984325+0000","last_peered":"2021-01-28T04:12:20.984325+0000","last_clean":"2021-01-28T04:12:20.984325+0000","last_became_active":"2021-01-28T04:11:17.629180+0000","last_became_peered":"2021-01-28T04:11:17.629180+0000","last_unstale":"2021-01-28T04:12:20.984325+0000","last_undegraded":"2021-01-28T04:12:20.984325+0000","last_fullsized":"2021-01-28T04:12:20.984325+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981280+0000","last_change":"2021-01-28T04:10:54.296826+0000","last_active":"2021-01-28T04:12:20.981280+0000","last_peered":"2021-01-28T04:12:20.981280+0000","last_clean":"2021-01-28T04:12:20.981280+0000","last_became_active":"2021-01-28T04:10:54.296387+0000","last_became_peered":"2021-01-28T04:10:54.296387+0000","last_unstale":"2021-01-28T04:12:20.981280+0000","last_undegraded":"2021-01-28T04:12:20.981280+0000","last_fullsized":"2021-01-28T04:12:20.981280+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"60'12","reported_seq":"40","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.965826+0000","last_change":"2021-01-28T04:11:15.619160+0000","last_active":"2021-01-28T04:12:20.965826+0000","last_peered":"2021-01-28T04:12:20.965826+0000","last_clean":"2021-01-28T04:12:20.965826+0000","last_became_active":"2021-01-28T04:11:15.618782+0000","last_became_peered":"2021-01-28T04:11:15.618782+0000","last_unstale":"2021-01-28T04:12:20.965826+0000","last_undegraded":"2021-01-28T04:12:20.965826+0000","last_fullsized":"2021-01-28T04:12:20.965826+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":12,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1252,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":12,"num_write":12,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966160+0000","last_change":"2021-01-28T04:11:20.681912+0000","last_active":"2021-01-28T04:12:20.966160+0000","last_peered":"2021-01-28T04:12:20.966160+0000","last_clean":"2021-01-28T04:12:20.966160+0000","last_became_active":"2021-01-28T04:11:20.681543+0000","last_became_peered":"2021-01-28T04:11:20.681543+0000","last_unstale":"2021-01-28T04:12:20.966160+0000","last_undegraded":"2021-01-28T04:12:20.966160+0000","last_fullsized":"2021-01-28T04:12:20.966160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976955+0000","last_change":"2021-01-28T04:11:17.617624+0000","last_active":"2021-01-28T04:12:20.976955+0000","last_peered":"2021-01-28T04:12:20.976955+0000","last_clean":"2021-01-28T04:12:20.976955+0000","last_became_active":"2021-01-28T04:11:17.617104+0000","last_became_peered":"2021-01-28T04:11:17.617104+0000","last_unstale":"2021-01-28T04:12:20.976955+0000","last_undegraded":"2021-01-28T04:12:20.976955+0000","last_fullsized":"2021-01-28T04:12:20.976955+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":"25","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978425+0000","last_change":"2021-01-28T04:10:54.297929+0000","last_active":"2021-01-28T04:12:20.978425+0000","last_peered":"2021-01-28T04:12:20.978425+0000","last_clean":"2021-01-28T04:12:20.978425+0000","last_became_active":"2021-01-28T04:10:54.295428+0000","last_became_peered":"2021-01-28T04:10:54.295428+0000","last_unstale":"2021-01-28T04:12:20.978425+0000","last_undegraded":"2021-01-28T04:12:20.978425+0000","last_fullsized":"2021-01-28T04:12:20.978425+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"60'15","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987676+0000","last_change":"2021-01-28T04:11:15.616274+0000","last_active":"2021-01-28T04:12:20.987676+0000","last_peered":"2021-01-28T04:12:20.987676+0000","last_clean":"2021-01-28T04:12:20.987676+0000","last_became_active":"2021-01-28T04:11:15.615902+0000","last_became_peered":"2021-01-28T04:11:15.615902+0000","last_unstale":"2021-01-28T04:12:20.987676+0000","last_undegraded":"2021-01-28T04:12:20.987676+0000","last_fullsized":"2021-01-28T04:12:20.987676+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":736,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":17,"num_write":16,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966641+0000","last_change":"2021-01-28T04:11:20.676769+0000","last_active":"2021-01-28T04:12:20.966641+0000","last_peered":"2021-01-28T04:12:20.966641+0000","last_clean":"2021-01-28T04:12:20.966641+0000","last_became_active":"2021-01-28T04:11:20.675777+0000","last_became_peered":"2021-01-28T04:11:20.675777+0000","last_unstale":"2021-01-28T04:12:20.966641+0000","last_undegraded":"2021-01-28T04:12:20.966641+0000","last_fullsized":"2021-01-28T04:12:20.966641+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,1],"acting":[0,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967437+0000","last_change":"2021-01-28T04:11:17.626405+0000","last_active":"2021-01-28T04:12:20.967437+0000","last_peered":"2021-01-28T04:12:20.967437+0000","last_clean":"2021-01-28T04:12:20.967437+0000","last_became_active":"2021-01-28T04:11:17.625949+0000","last_became_peered":"2021-01-28T04:11:17.625949+0000","last_unstale":"2021-01-28T04:12:20.967437+0000","last_undegraded":"2021-01-28T04:12:20.967437+0000","last_fullsized":"2021-01-28T04:12:20.967437+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987131+0000","last_change":"2021-01-28T04:10:54.301559+0000","last_active":"2021-01-28T04:12:20.987131+0000","last_peered":"2021-01-28T04:12:20.987131+0000","last_clean":"2021-01-28T04:12:20.987131+0000","last_became_active":"2021-01-28T04:10:54.301175+0000","last_became_peered":"2021-01-28T04:10:54.301175+0000","last_unstale":"2021-01-28T04:12:20.987131+0000","last_undegraded":"2021-01-28T04:12:20.987131+0000","last_fullsized":"2021-01-28T04:12:20.987131+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5],"acting":[6,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"60'15","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976879+0000","last_change":"2021-01-28T04:11:15.615936+0000","last_active":"2021-01-28T04:12:20.976879+0000","last_peered":"2021-01-28T04:12:20.976879+0000","last_clean":"2021-01-28T04:12:20.976879+0000","last_became_active":"2021-01-28T04:11:15.615461+0000","last_became_peered":"2021-01-28T04:11:15.615461+0000","last_unstale":"2021-01-28T04:12:20.976879+0000","last_undegraded":"2021-01-28T04:12:20.976879+0000","last_fullsized":"2021-01-28T04:12:20.976879+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1050,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":35,"num_read_kb":17,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.988714+0000","last_change":"2021-01-28T04:11:20.672989+0000","last_active":"2021-01-28T04:12:20.988714+0000","last_peered":"2021-01-28T04:12:20.988714+0000","last_clean":"2021-01-28T04:12:20.988714+0000","last_became_active":"2021-01-28T04:11:20.672381+0000","last_became_peered":"2021-01-28T04:11:20.672381+0000","last_unstale":"2021-01-28T04:12:20.988714+0000","last_undegraded":"2021-01-28T04:12:20.988714+0000","last_fullsized":"2021-01-28T04:12:20.988714+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,5],"acting":[4,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"55'2","reported_seq":"55","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:13.785466+0000","last_change":"2021-01-28T04:11:17.619763+0000","last_active":"2021-01-28T04:14:13.785466+0000","last_peered":"2021-01-28T04:14:13.785466+0000","last_clean":"2021-01-28T04:14:13.785466+0000","last_became_active":"2021-01-28T04:11:17.619405+0000","last_became_peered":"2021-01-28T04:11:17.619405+0000","last_unstale":"2021-01-28T04:14:13.785466+0000","last_undegraded":"2021-01-28T04:14:13.785466+0000","last_fullsized":"2021-01-28T04:14:13.785466+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,2],"acting":[3,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":"26","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968509+0000","last_change":"2021-01-28T04:10:54.305888+0000","last_active":"2021-01-28T04:12:20.968509+0000","last_peered":"2021-01-28T04:12:20.968509+0000","last_clean":"2021-01-28T04:12:20.968509+0000","last_became_active":"2021-01-28T04:10:54.305516+0000","last_became_peered":"2021-01-28T04:10:54.305516+0000","last_unstale":"2021-01-28T04:12:20.968509+0000","last_undegraded":"2021-01-28T04:12:20.968509+0000","last_fullsized":"2021-01-28T04:12:20.968509+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"60'19","reported_seq":"57","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981003+0000","last_change":"2021-01-28T04:11:15.628402+0000","last_active":"2021-01-28T04:12:20.981003+0000","last_peered":"2021-01-28T04:12:20.981003+0000","last_clean":"2021-01-28T04:12:20.981003+0000","last_became_active":"2021-01-28T04:11:15.628030+0000","last_became_peered":"2021-01-28T04:11:15.628030+0000","last_unstale":"2021-01-28T04:12:20.981003+0000","last_undegraded":"2021-01-28T04:12:20.981003+0000","last_fullsized":"2021-01-28T04:12:20.981003+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":19,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":41,"num_read_kb":26,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967797+0000","last_change":"2021-01-28T04:11:20.675748+0000","last_active":"2021-01-28T04:12:20.967797+0000","last_peered":"2021-01-28T04:12:20.967797+0000","last_clean":"2021-01-28T04:12:20.967797+0000","last_became_active":"2021-01-28T04:11:20.674748+0000","last_became_peered":"2021-01-28T04:11:20.674748+0000","last_unstale":"2021-01-28T04:12:20.967797+0000","last_undegraded":"2021-01-28T04:12:20.967797+0000","last_fullsized":"2021-01-28T04:12:20.967797+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"55'2","reported_seq":"54","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.786892+0000","last_change":"2021-01-28T04:11:17.630860+0000","last_active":"2021-01-28T04:14:08.786892+0000","last_peered":"2021-01-28T04:14:08.786892+0000","last_clean":"2021-01-28T04:14:08.786892+0000","last_became_active":"2021-01-28T04:11:17.630472+0000","last_became_peered":"2021-01-28T04:11:17.630472+0000","last_unstale":"2021-01-28T04:14:08.786892+0000","last_undegraded":"2021-01-28T04:14:08.786892+0000","last_fullsized":"2021-01-28T04:14:08.786892+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.12","version":"45'2","reported_seq":"45","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978671+0000","last_change":"2021-01-28T04:10:59.457241+0000","last_active":"2021-01-28T04:12:20.978671+0000","last_peered":"2021-01-28T04:12:20.978671+0000","last_clean":"2021-01-28T04:12:20.978671+0000","last_became_active":"2021-01-28T04:10:59.353495+0000","last_became_peered":"2021-01-28T04:10:59.353495+0000","last_unstale":"2021-01-28T04:12:20.978671+0000","last_undegraded":"2021-01-28T04:12:20.978671+0000","last_fullsized":"2021-01-28T04:12:20.978671+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"60'26","reported_seq":"71","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967994+0000","last_change":"2021-01-28T04:11:15.629037+0000","last_active":"2021-01-28T04:12:20.967994+0000","last_peered":"2021-01-28T04:12:20.967994+0000","last_clean":"2021-01-28T04:12:20.967994+0000","last_became_active":"2021-01-28T04:11:15.628589+0000","last_became_peered":"2021-01-28T04:11:15.628589+0000","last_unstale":"2021-01-28T04:12:20.967994+0000","last_undegraded":"2021-01-28T04:12:20.967994+0000","last_fullsized":"2021-01-28T04:12:20.967994+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":624,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":51,"num_read_kb":36,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982183+0000","last_change":"2021-01-28T04:11:20.762404+0000","last_active":"2021-01-28T04:12:20.982183+0000","last_peered":"2021-01-28T04:12:20.982183+0000","last_clean":"2021-01-28T04:12:20.982183+0000","last_became_active":"2021-01-28T04:11:20.761936+0000","last_became_peered":"2021-01-28T04:11:20.761936+0000","last_unstale":"2021-01-28T04:12:20.982183+0000","last_undegraded":"2021-01-28T04:12:20.982183+0000","last_fullsized":"2021-01-28T04:12:20.982183+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981097+0000","last_change":"2021-01-28T04:11:17.627364+0000","last_active":"2021-01-28T04:12:20.981097+0000","last_peered":"2021-01-28T04:12:20.981097+0000","last_clean":"2021-01-28T04:12:20.981097+0000","last_became_active":"2021-01-28T04:11:17.626795+0000","last_became_peered":"2021-01-28T04:11:17.626795+0000","last_unstale":"2021-01-28T04:12:20.981097+0000","last_undegraded":"2021-01-28T04:12:20.981097+0000","last_fullsized":"2021-01-28T04:12:20.981097+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.11","version":"50'2","reported_seq":"31","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.985581+0000","last_change":"2021-01-28T04:10:54.292855+0000","last_active":"2021-01-28T04:12:20.985581+0000","last_peered":"2021-01-28T04:12:20.985581+0000","last_clean":"2021-01-28T04:12:20.985581+0000","last_became_active":"2021-01-28T04:10:54.292400+0000","last_became_peered":"2021-01-28T04:10:54.292400+0000","last_unstale":"2021-01-28T04:12:20.985581+0000","last_undegraded":"2021-01-28T04:12:20.985581+0000","last_fullsized":"2021-01-28T04:12:20.985581+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":293,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"60'13","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.970618+0000","last_change":"2021-01-28T04:11:15.629147+0000","last_active":"2021-01-28T04:12:20.970618+0000","last_peered":"2021-01-28T04:12:20.970618+0000","last_clean":"2021-01-28T04:12:20.970618+0000","last_became_active":"2021-01-28T04:11:15.628780+0000","last_became_peered":"2021-01-28T04:11:15.628780+0000","last_unstale":"2021-01-28T04:12:20.970618+0000","last_undegraded":"2021-01-28T04:12:20.970618+0000","last_fullsized":"2021-01-28T04:12:20.970618+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":158,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":24,"num_read_kb":18,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976134+0000","last_change":"2021-01-28T04:11:20.669742+0000","last_active":"2021-01-28T04:12:20.976134+0000","last_peered":"2021-01-28T04:12:20.976134+0000","last_clean":"2021-01-28T04:12:20.976134+0000","last_became_active":"2021-01-28T04:11:20.669331+0000","last_became_peered":"2021-01-28T04:11:20.669331+0000","last_unstale":"2021-01-28T04:12:20.976134+0000","last_undegraded":"2021-01-28T04:12:20.976134+0000","last_fullsized":"2021-01-28T04:12:20.976134+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.970837+0000","last_change":"2021-01-28T04:11:17.619979+0000","last_active":"2021-01-28T04:12:20.970837+0000","last_peered":"2021-01-28T04:12:20.970837+0000","last_clean":"2021-01-28T04:12:20.970837+0000","last_became_active":"2021-01-28T04:11:17.619574+0000","last_became_peered":"2021-01-28T04:11:17.619574+0000","last_unstale":"2021-01-28T04:12:20.970837+0000","last_undegraded":"2021-01-28T04:12:20.970837+0000","last_fullsized":"2021-01-28T04:12:20.970837+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"45'2","reported_seq":"34","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.974652+0000","last_change":"2021-01-28T04:10:54.307652+0000","last_active":"2021-01-28T04:12:20.974652+0000","last_peered":"2021-01-28T04:12:20.974652+0000","last_clean":"2021-01-28T04:12:20.974652+0000","last_became_active":"2021-01-28T04:10:54.307237+0000","last_became_peered":"2021-01-28T04:10:54.307237+0000","last_unstale":"2021-01-28T04:12:20.974652+0000","last_undegraded":"2021-01-28T04:12:20.974652+0000","last_fullsized":"2021-01-28T04:12:20.974652+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":105,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0],"acting":[2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"60'29","reported_seq":"79","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968180+0000","last_change":"2021-01-28T04:11:15.630524+0000","last_active":"2021-01-28T04:12:20.968180+0000","last_peered":"2021-01-28T04:12:20.968180+0000","last_clean":"2021-01-28T04:12:20.968180+0000","last_became_active":"2021-01-28T04:11:15.629826+0000","last_became_peered":"2021-01-28T04:11:15.629826+0000","last_unstale":"2021-01-28T04:12:20.968180+0000","last_undegraded":"2021-01-28T04:12:20.968180+0000","last_fullsized":"2021-01-28T04:12:20.968180+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1206,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":62,"num_read_kb":40,"num_write":29,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967546+0000","last_change":"2021-01-28T04:11:20.683685+0000","last_active":"2021-01-28T04:12:20.967546+0000","last_peered":"2021-01-28T04:12:20.967546+0000","last_clean":"2021-01-28T04:12:20.967546+0000","last_became_active":"2021-01-28T04:11:20.683319+0000","last_became_peered":"2021-01-28T04:11:20.683319+0000","last_unstale":"2021-01-28T04:12:20.967546+0000","last_undegraded":"2021-01-28T04:12:20.967546+0000","last_fullsized":"2021-01-28T04:12:20.967546+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.f","version":"50'2","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.988493+0000","last_change":"2021-01-28T04:10:59.453102+0000","last_active":"2021-01-28T04:12:20.988493+0000","last_peered":"2021-01-28T04:12:20.988493+0000","last_clean":"2021-01-28T04:12:20.988493+0000","last_became_active":"2021-01-28T04:10:59.350707+0000","last_became_peered":"2021-01-28T04:10:59.350707+0000","last_unstale":"2021-01-28T04:12:20.988493+0000","last_undegraded":"2021-01-28T04:12:20.988493+0000","last_fullsized":"2021-01-28T04:12:20.988493+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":10,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,7],"acting":[4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"60'27","reported_seq":"76","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.983110+0000","last_change":"2021-01-28T04:11:15.620355+0000","last_active":"2021-01-28T04:12:20.983110+0000","last_peered":"2021-01-28T04:12:20.983110+0000","last_clean":"2021-01-28T04:12:20.983110+0000","last_became_active":"2021-01-28T04:11:15.619966+0000","last_became_peered":"2021-01-28T04:11:15.619966+0000","last_unstale":"2021-01-28T04:12:20.983110+0000","last_undegraded":"2021-01-28T04:12:20.983110+0000","last_fullsized":"2021-01-28T04:12:20.983110+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":692,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":58,"num_read_kb":41,"num_write":29,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.974532+0000","last_change":"2021-01-28T04:11:17.629483+0000","last_active":"2021-01-28T04:12:20.974532+0000","last_peered":"2021-01-28T04:12:20.974532+0000","last_clean":"2021-01-28T04:12:20.974532+0000","last_became_active":"2021-01-28T04:11:17.629094+0000","last_became_peered":"2021-01-28T04:11:17.629094+0000","last_unstale":"2021-01-28T04:12:20.974532+0000","last_undegraded":"2021-01-28T04:12:20.974532+0000","last_fullsized":"2021-01-28T04:12:20.974532+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966778+0000","last_change":"2021-01-28T04:11:20.677041+0000","last_active":"2021-01-28T04:12:20.966778+0000","last_peered":"2021-01-28T04:12:20.966778+0000","last_clean":"2021-01-28T04:12:20.966778+0000","last_became_active":"2021-01-28T04:11:20.676610+0000","last_became_peered":"2021-01-28T04:11:20.676610+0000","last_unstale":"2021-01-28T04:12:20.966778+0000","last_undegraded":"2021-01-28T04:12:20.966778+0000","last_fullsized":"2021-01-28T04:12:20.966778+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2],"acting":[0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"34","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978049+0000","last_change":"2021-01-28T04:10:59.351160+0000","last_active":"2021-01-28T04:12:20.978049+0000","last_peered":"2021-01-28T04:12:20.978049+0000","last_clean":"2021-01-28T04:12:20.978049+0000","last_became_active":"2021-01-28T04:10:59.350473+0000","last_became_peered":"2021-01-28T04:10:59.350473+0000","last_unstale":"2021-01-28T04:12:20.978049+0000","last_undegraded":"2021-01-28T04:12:20.978049+0000","last_fullsized":"2021-01-28T04:12:20.978049+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"60'22","reported_seq":"59","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.977058+0000","last_change":"2021-01-28T04:11:15.612138+0000","last_active":"2021-01-28T04:12:20.977058+0000","last_peered":"2021-01-28T04:12:20.977058+0000","last_clean":"2021-01-28T04:12:20.977058+0000","last_became_active":"2021-01-28T04:11:15.610272+0000","last_became_peered":"2021-01-28T04:11:15.610272+0000","last_unstale":"2021-01-28T04:12:20.977058+0000","last_undegraded":"2021-01-28T04:12:20.977058+0000","last_fullsized":"2021-01-28T04:12:20.977058+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":22,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":45,"num_read_kb":27,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"55'2","reported_seq":"54","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.784943+0000","last_change":"2021-01-28T04:11:17.632119+0000","last_active":"2021-01-28T04:14:08.784943+0000","last_peered":"2021-01-28T04:14:08.784943+0000","last_clean":"2021-01-28T04:14:08.784943+0000","last_became_active":"2021-01-28T04:11:17.631728+0000","last_became_peered":"2021-01-28T04:11:17.631728+0000","last_unstale":"2021-01-28T04:14:08.784943+0000","last_undegraded":"2021-01-28T04:14:08.784943+0000","last_fullsized":"2021-01-28T04:14:08.784943+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,5],"acting":[0,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.971563+0000","last_change":"2021-01-28T04:11:20.683162+0000","last_active":"2021-01-28T04:12:20.971563+0000","last_peered":"2021-01-28T04:12:20.971563+0000","last_clean":"2021-01-28T04:12:20.971563+0000","last_became_active":"2021-01-28T04:11:20.682818+0000","last_became_peered":"2021-01-28T04:11:20.682818+0000","last_unstale":"2021-01-28T04:12:20.971563+0000","last_undegraded":"2021-01-28T04:12:20.971563+0000","last_fullsized":"2021-01-28T04:12:20.971563+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,7],"acting":[3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"60'2","reported_seq":"62","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.022108+0000","last_change":"2021-01-28T04:10:54.300484+0000","last_active":"2021-01-28T04:14:08.022108+0000","last_peered":"2021-01-28T04:14:08.022108+0000","last_clean":"2021-01-28T04:14:08.022108+0000","last_became_active":"2021-01-28T04:10:54.300102+0000","last_became_peered":"2021-01-28T04:10:54.300102+0000","last_unstale":"2021-01-28T04:14:08.022108+0000","last_undegraded":"2021-01-28T04:14:08.022108+0000","last_fullsized":"2021-01-28T04:14:08.022108+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"60'31","reported_seq":"79","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978095+0000","last_change":"2021-01-28T04:11:15.618251+0000","last_active":"2021-01-28T04:12:20.978095+0000","last_peered":"2021-01-28T04:12:20.978095+0000","last_clean":"2021-01-28T04:12:20.978095+0000","last_became_active":"2021-01-28T04:11:15.617850+0000","last_became_peered":"2021-01-28T04:11:15.617850+0000","last_unstale":"2021-01-28T04:12:20.978095+0000","last_undegraded":"2021-01-28T04:12:20.978095+0000","last_fullsized":"2021-01-28T04:12:20.978095+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":31,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":954,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":66,"num_read_kb":42,"num_write":34,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968970+0000","last_change":"2021-01-28T04:11:17.628341+0000","last_active":"2021-01-28T04:12:20.968970+0000","last_peered":"2021-01-28T04:12:20.968970+0000","last_clean":"2021-01-28T04:12:20.968970+0000","last_became_active":"2021-01-28T04:11:17.627918+0000","last_became_peered":"2021-01-28T04:11:17.627918+0000","last_unstale":"2021-01-28T04:12:20.968970+0000","last_undegraded":"2021-01-28T04:12:20.968970+0000","last_fullsized":"2021-01-28T04:12:20.968970+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982881+0000","last_change":"2021-01-28T04:11:20.762177+0000","last_active":"2021-01-28T04:12:20.982881+0000","last_peered":"2021-01-28T04:12:20.982881+0000","last_clean":"2021-01-28T04:12:20.982881+0000","last_became_active":"2021-01-28T04:11:20.761235+0000","last_became_peered":"2021-01-28T04:11:20.761235+0000","last_unstale":"2021-01-28T04:12:20.982881+0000","last_undegraded":"2021-01-28T04:12:20.982881+0000","last_fullsized":"2021-01-28T04:12:20.982881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,3],"acting":[7,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"60'5","reported_seq":"192","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:15.761389+0000","last_change":"2021-01-28T04:11:14.605443+0000","last_active":"2021-01-28T04:14:15.761389+0000","last_peered":"2021-01-28T04:14:15.761389+0000","last_clean":"2021-01-28T04:14:15.761389+0000","last_became_active":"2021-01-28T04:11:14.605057+0000","last_became_peered":"2021-01-28T04:11:14.605057+0000","last_unstale":"2021-01-28T04:14:15.761389+0000","last_undegraded":"2021-01-28T04:14:15.761389+0000","last_fullsized":"2021-01-28T04:14:15.761389+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_clean_scrub_stamp":"2021-01-28T04:11:13.576846+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":166,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"25","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.974976+0000","last_change":"2021-01-28T04:10:54.298297+0000","last_active":"2021-01-28T04:12:20.974976+0000","last_peered":"2021-01-28T04:12:20.974976+0000","last_clean":"2021-01-28T04:12:20.974976+0000","last_became_active":"2021-01-28T04:10:54.297767+0000","last_became_peered":"2021-01-28T04:10:54.297767+0000","last_unstale":"2021-01-28T04:12:20.974976+0000","last_undegraded":"2021-01-28T04:12:20.974976+0000","last_fullsized":"2021-01-28T04:12:20.974976+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"60'21","reported_seq":"28","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:12:22.040522+0000","last_change":"2021-01-28T04:12:22.040522+0000","last_active":"2021-01-28T04:12:22.040522+0000","last_peered":"2021-01-28T04:12:22.040522+0000","last_clean":"2021-01-28T04:12:22.040522+0000","last_became_active":"2021-01-28T04:12:21.992345+0000","last_became_peered":"2021-01-28T04:12:21.992345+0000","last_unstale":"2021-01-28T04:12:22.040522+0000","last_undegraded":"2021-01-28T04:12:22.040522+0000","last_fullsized":"2021-01-28T04:12:22.040522+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":644,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":31,"num_write":24,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":644,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.977290+0000","last_change":"2021-01-28T04:11:17.620144+0000","last_active":"2021-01-28T04:12:20.977290+0000","last_peered":"2021-01-28T04:12:20.977290+0000","last_clean":"2021-01-28T04:12:20.977290+0000","last_became_active":"2021-01-28T04:11:17.619453+0000","last_became_peered":"2021-01-28T04:11:17.619453+0000","last_unstale":"2021-01-28T04:12:20.977290+0000","last_undegraded":"2021-01-28T04:12:20.977290+0000","last_fullsized":"2021-01-28T04:12:20.977290+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7],"acting":[2,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981160+0000","last_change":"2021-01-28T04:11:20.676481+0000","last_active":"2021-01-28T04:12:20.981160+0000","last_peered":"2021-01-28T04:12:20.981160+0000","last_clean":"2021-01-28T04:12:20.981160+0000","last_became_active":"2021-01-28T04:11:20.676011+0000","last_became_peered":"2021-01-28T04:11:20.676011+0000","last_unstale":"2021-01-28T04:12:20.981160+0000","last_undegraded":"2021-01-28T04:12:20.981160+0000","last_fullsized":"2021-01-28T04:12:20.981160+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,4],"acting":[5,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"19","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967471+0000","last_change":"2021-01-28T04:11:14.605941+0000","last_active":"2021-01-28T04:12:20.967471+0000","last_peered":"2021-01-28T04:12:20.967471+0000","last_clean":"2021-01-28T04:12:20.967471+0000","last_became_active":"2021-01-28T04:11:14.605387+0000","last_became_peered":"2021-01-28T04:11:14.605387+0000","last_unstale":"2021-01-28T04:12:20.967471+0000","last_undegraded":"2021-01-28T04:12:20.967471+0000","last_fullsized":"2021-01-28T04:12:20.967471+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_clean_scrub_stamp":"2021-01-28T04:11:13.576846+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"36","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.979009+0000","last_change":"2021-01-28T04:10:59.352635+0000","last_active":"2021-01-28T04:12:20.979009+0000","last_peered":"2021-01-28T04:12:20.979009+0000","last_clean":"2021-01-28T04:12:20.979009+0000","last_became_active":"2021-01-28T04:10:59.351748+0000","last_became_peered":"2021-01-28T04:10:59.351748+0000","last_unstale":"2021-01-28T04:12:20.979009+0000","last_undegraded":"2021-01-28T04:12:20.979009+0000","last_fullsized":"2021-01-28T04:12:20.979009+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981846+0000","last_change":"2021-01-28T04:10:59.357806+0000","last_active":"2021-01-28T04:12:20.981846+0000","last_peered":"2021-01-28T04:12:20.981846+0000","last_clean":"2021-01-28T04:12:20.981846+0000","last_became_active":"2021-01-28T04:10:59.357187+0000","last_became_peered":"2021-01-28T04:10:59.357187+0000","last_unstale":"2021-01-28T04:12:20.981846+0000","last_undegraded":"2021-01-28T04:12:20.981846+0000","last_fullsized":"2021-01-28T04:12:20.981846+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":5,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:06:15.076818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:06:15.076818+0000","last_clean_scrub_stamp":"2021-01-28T04:06:15.076818+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"60'15","reported_seq":"42","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986992+0000","last_change":"2021-01-28T04:11:15.626442+0000","last_active":"2021-01-28T04:12:20.986992+0000","last_peered":"2021-01-28T04:12:20.986992+0000","last_clean":"2021-01-28T04:12:20.986992+0000","last_became_active":"2021-01-28T04:11:15.625659+0000","last_became_peered":"2021-01-28T04:11:15.625659+0000","last_unstale":"2021-01-28T04:12:20.986992+0000","last_undegraded":"2021-01-28T04:12:20.986992+0000","last_fullsized":"2021-01-28T04:12:20.986992+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":15,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":466,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":27,"num_read_kb":15,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984228+0000","last_change":"2021-01-28T04:11:17.619525+0000","last_active":"2021-01-28T04:12:20.984228+0000","last_peered":"2021-01-28T04:12:20.984228+0000","last_clean":"2021-01-28T04:12:20.984228+0000","last_became_active":"2021-01-28T04:11:17.619030+0000","last_became_peered":"2021-01-28T04:11:17.619030+0000","last_unstale":"2021-01-28T04:12:20.984228+0000","last_undegraded":"2021-01-28T04:12:20.984228+0000","last_fullsized":"2021-01-28T04:12:20.984228+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,5],"acting":[7,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.977873+0000","last_change":"2021-01-28T04:11:20.675590+0000","last_active":"2021-01-28T04:12:20.977873+0000","last_peered":"2021-01-28T04:12:20.977873+0000","last_clean":"2021-01-28T04:12:20.977873+0000","last_became_active":"2021-01-28T04:11:20.675115+0000","last_became_peered":"2021-01-28T04:11:20.675115+0000","last_unstale":"2021-01-28T04:12:20.977873+0000","last_undegraded":"2021-01-28T04:12:20.977873+0000","last_fullsized":"2021-01-28T04:12:20.977873+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"19","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967547+0000","last_change":"2021-01-28T04:11:14.600853+0000","last_active":"2021-01-28T04:12:20.967547+0000","last_peered":"2021-01-28T04:12:20.967547+0000","last_clean":"2021-01-28T04:12:20.967547+0000","last_became_active":"2021-01-28T04:11:14.600451+0000","last_became_peered":"2021-01-28T04:11:14.600451+0000","last_unstale":"2021-01-28T04:12:20.967547+0000","last_undegraded":"2021-01-28T04:12:20.967547+0000","last_fullsized":"2021-01-28T04:12:20.967547+0000","mapping_epoch":51,"log_start":"0'0","ondisk_log_start":"0'0","created":51,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:13.576846+0000","last_clean_scrub_stamp":"2021-01-28T04:11:13.576846+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982178+0000","last_change":"2021-01-28T04:10:59.358319+0000","last_active":"2021-01-28T04:12:20.982178+0000","last_peered":"2021-01-28T04:12:20.982178+0000","last_clean":"2021-01-28T04:12:20.982178+0000","last_became_active":"2021-01-28T04:10:59.357447+0000","last_became_peered":"2021-01-28T04:10:59.357447+0000","last_unstale":"2021-01-28T04:12:20.982178+0000","last_undegraded":"2021-01-28T04:12:20.982178+0000","last_fullsized":"2021-01-28T04:12:20.982178+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"60'16","reported_seq":"44","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967983+0000","last_change":"2021-01-28T04:11:15.627576+0000","last_active":"2021-01-28T04:12:20.967983+0000","last_peered":"2021-01-28T04:12:20.967983+0000","last_clean":"2021-01-28T04:12:20.967983+0000","last_became_active":"2021-01-28T04:11:15.627129+0000","last_became_peered":"2021-01-28T04:11:15.627129+0000","last_unstale":"2021-01-28T04:12:20.967983+0000","last_undegraded":"2021-01-28T04:12:20.967983+0000","last_fullsized":"2021-01-28T04:12:20.967983+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":16,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":630,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":30,"num_read_kb":16,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.980958+0000","last_change":"2021-01-28T04:11:17.631106+0000","last_active":"2021-01-28T04:12:20.980958+0000","last_peered":"2021-01-28T04:12:20.980958+0000","last_clean":"2021-01-28T04:12:20.980958+0000","last_became_active":"2021-01-28T04:11:17.630690+0000","last_became_peered":"2021-01-28T04:11:17.630690+0000","last_unstale":"2021-01-28T04:12:20.980958+0000","last_undegraded":"2021-01-28T04:12:20.980958+0000","last_fullsized":"2021-01-28T04:12:20.980958+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976384+0000","last_change":"2021-01-28T04:11:20.762847+0000","last_active":"2021-01-28T04:12:20.976384+0000","last_peered":"2021-01-28T04:12:20.976384+0000","last_clean":"2021-01-28T04:12:20.976384+0000","last_became_active":"2021-01-28T04:11:20.761749+0000","last_became_peered":"2021-01-28T04:11:20.761749+0000","last_unstale":"2021-01-28T04:12:20.976384+0000","last_undegraded":"2021-01-28T04:12:20.976384+0000","last_fullsized":"2021-01-28T04:12:20.976384+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.983135+0000","last_change":"2021-01-28T04:10:59.357324+0000","last_active":"2021-01-28T04:12:20.983135+0000","last_peered":"2021-01-28T04:12:20.983135+0000","last_clean":"2021-01-28T04:12:20.983135+0000","last_became_active":"2021-01-28T04:10:59.356419+0000","last_became_peered":"2021-01-28T04:10:59.356419+0000","last_unstale":"2021-01-28T04:12:20.983135+0000","last_undegraded":"2021-01-28T04:12:20.983135+0000","last_fullsized":"2021-01-28T04:12:20.983135+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"60'27","reported_seq":"73","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.968377+0000","last_change":"2021-01-28T04:11:15.631566+0000","last_active":"2021-01-28T04:12:20.968377+0000","last_peered":"2021-01-28T04:12:20.968377+0000","last_clean":"2021-01-28T04:12:20.968377+0000","last_became_active":"2021-01-28T04:11:15.630801+0000","last_became_peered":"2021-01-28T04:11:15.630801+0000","last_unstale":"2021-01-28T04:12:20.968377+0000","last_undegraded":"2021-01-28T04:12:20.968377+0000","last_fullsized":"2021-01-28T04:12:20.968377+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":27,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":642,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":57,"num_read_kb":38,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986264+0000","last_change":"2021-01-28T04:11:17.639870+0000","last_active":"2021-01-28T04:12:20.986264+0000","last_peered":"2021-01-28T04:12:20.986264+0000","last_clean":"2021-01-28T04:12:20.986264+0000","last_became_active":"2021-01-28T04:11:17.639473+0000","last_became_peered":"2021-01-28T04:11:17.639473+0000","last_unstale":"2021-01-28T04:12:20.986264+0000","last_undegraded":"2021-01-28T04:12:20.986264+0000","last_fullsized":"2021-01-28T04:12:20.986264+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987205+0000","last_change":"2021-01-28T04:11:20.677128+0000","last_active":"2021-01-28T04:12:20.987205+0000","last_peered":"2021-01-28T04:12:20.987205+0000","last_clean":"2021-01-28T04:12:20.987205+0000","last_became_active":"2021-01-28T04:11:20.676386+0000","last_became_peered":"2021-01-28T04:11:20.676386+0000","last_unstale":"2021-01-28T04:12:20.987205+0000","last_undegraded":"2021-01-28T04:12:20.987205+0000","last_fullsized":"2021-01-28T04:12:20.987205+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,2],"acting":[4,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"34","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978873+0000","last_change":"2021-01-28T04:10:58.346125+0000","last_active":"2021-01-28T04:12:20.978873+0000","last_peered":"2021-01-28T04:12:20.978873+0000","last_clean":"2021-01-28T04:12:20.978873+0000","last_became_active":"2021-01-28T04:10:58.345120+0000","last_became_peered":"2021-01-28T04:10:58.345120+0000","last_unstale":"2021-01-28T04:12:20.978873+0000","last_undegraded":"2021-01-28T04:12:20.978873+0000","last_fullsized":"2021-01-28T04:12:20.978873+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"60'34","reported_seq":"88","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.965588+0000","last_change":"2021-01-28T04:11:15.629794+0000","last_active":"2021-01-28T04:12:20.965588+0000","last_peered":"2021-01-28T04:12:20.965588+0000","last_clean":"2021-01-28T04:12:20.965588+0000","last_became_active":"2021-01-28T04:11:15.629367+0000","last_became_peered":"2021-01-28T04:11:15.629367+0000","last_unstale":"2021-01-28T04:12:20.965588+0000","last_undegraded":"2021-01-28T04:12:20.965588+0000","last_fullsized":"2021-01-28T04:12:20.965588+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":34,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":70,"num_read_kb":48,"num_write":36,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.985703+0000","last_change":"2021-01-28T04:11:17.633133+0000","last_active":"2021-01-28T04:12:20.985703+0000","last_peered":"2021-01-28T04:12:20.985703+0000","last_clean":"2021-01-28T04:12:20.985703+0000","last_became_active":"2021-01-28T04:11:17.632719+0000","last_became_peered":"2021-01-28T04:11:17.632719+0000","last_unstale":"2021-01-28T04:12:20.985703+0000","last_undegraded":"2021-01-28T04:12:20.985703+0000","last_fullsized":"2021-01-28T04:12:20.985703+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,7],"acting":[4,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.985259+0000","last_change":"2021-01-28T04:11:20.762615+0000","last_active":"2021-01-28T04:12:20.985259+0000","last_peered":"2021-01-28T04:12:20.985259+0000","last_clean":"2021-01-28T04:12:20.985259+0000","last_became_active":"2021-01-28T04:11:20.761847+0000","last_became_peered":"2021-01-28T04:11:20.761847+0000","last_unstale":"2021-01-28T04:12:20.985259+0000","last_undegraded":"2021-01-28T04:12:20.985259+0000","last_fullsized":"2021-01-28T04:12:20.985259+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,2],"acting":[7,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"35","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.987550+0000","last_change":"2021-01-28T04:10:59.345346+0000","last_active":"2021-01-28T04:12:20.987550+0000","last_peered":"2021-01-28T04:12:20.987550+0000","last_clean":"2021-01-28T04:12:20.987550+0000","last_became_active":"2021-01-28T04:10:59.344747+0000","last_became_peered":"2021-01-28T04:10:59.344747+0000","last_unstale":"2021-01-28T04:12:20.987550+0000","last_undegraded":"2021-01-28T04:12:20.987550+0000","last_fullsized":"2021-01-28T04:12:20.987550+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"60'26","reported_seq":"65","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981337+0000","last_change":"2021-01-28T04:11:15.621067+0000","last_active":"2021-01-28T04:12:20.981337+0000","last_peered":"2021-01-28T04:12:20.981337+0000","last_clean":"2021-01-28T04:12:20.981337+0000","last_became_active":"2021-01-28T04:11:15.619844+0000","last_became_peered":"2021-01-28T04:11:15.619844+0000","last_unstale":"2021-01-28T04:12:20.981337+0000","last_undegraded":"2021-01-28T04:12:20.981337+0000","last_fullsized":"2021-01-28T04:12:20.981337+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":26,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":940,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":51,"num_read_kb":31,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6],"acting":[4,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.0","version":"55'2","reported_seq":"55","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:13.785266+0000","last_change":"2021-01-28T04:11:17.627764+0000","last_active":"2021-01-28T04:14:13.785266+0000","last_peered":"2021-01-28T04:14:13.785266+0000","last_clean":"2021-01-28T04:14:13.785266+0000","last_became_active":"2021-01-28T04:11:17.627244+0000","last_became_peered":"2021-01-28T04:11:17.627244+0000","last_unstale":"2021-01-28T04:14:13.785266+0000","last_undegraded":"2021-01-28T04:14:13.785266+0000","last_fullsized":"2021-01-28T04:14:13.785266+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4],"acting":[3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.967881+0000","last_change":"2021-01-28T04:11:20.762734+0000","last_active":"2021-01-28T04:12:20.967881+0000","last_peered":"2021-01-28T04:12:20.967881+0000","last_clean":"2021-01-28T04:12:20.967881+0000","last_became_active":"2021-01-28T04:11:20.761820+0000","last_became_peered":"2021-01-28T04:11:20.761820+0000","last_unstale":"2021-01-28T04:12:20.967881+0000","last_undegraded":"2021-01-28T04:12:20.967881+0000","last_fullsized":"2021-01-28T04:12:20.967881+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,5],"acting":[3,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":"16","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.980551+0000","last_change":"2021-01-28T04:11:17.628909+0000","last_active":"2021-01-28T04:12:20.980551+0000","last_peered":"2021-01-28T04:12:20.980551+0000","last_clean":"2021-01-28T04:12:20.980551+0000","last_became_active":"2021-01-28T04:11:17.628138+0000","last_became_peered":"2021-01-28T04:11:17.628138+0000","last_unstale":"2021-01-28T04:12:20.980551+0000","last_undegraded":"2021-01-28T04:12:20.980551+0000","last_fullsized":"2021-01-28T04:12:20.980551+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,6],"acting":[5,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.982017+0000","last_change":"2021-01-28T04:10:59.359022+0000","last_active":"2021-01-28T04:12:20.982017+0000","last_peered":"2021-01-28T04:12:20.982017+0000","last_clean":"2021-01-28T04:12:20.982017+0000","last_became_active":"2021-01-28T04:10:59.358076+0000","last_became_peered":"2021-01-28T04:10:59.358076+0000","last_unstale":"2021-01-28T04:12:20.982017+0000","last_undegraded":"2021-01-28T04:12:20.982017+0000","last_fullsized":"2021-01-28T04:12:20.982017+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,1],"acting":[7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"60'21","reported_seq":"90","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:12:22.022671+0000","last_change":"2021-01-28T04:12:22.022671+0000","last_active":"2021-01-28T04:12:22.022671+0000","last_peered":"2021-01-28T04:12:22.022671+0000","last_clean":"2021-01-28T04:12:22.022671+0000","last_became_active":"2021-01-28T04:12:21.993811+0000","last_became_peered":"2021-01-28T04:12:21.993811+0000","last_unstale":"2021-01-28T04:12:22.022671+0000","last_undegraded":"2021-01-28T04:12:22.022671+0000","last_fullsized":"2021-01-28T04:12:22.022671+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":738,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":28,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":738,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5],"acting":[4,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.980229+0000","last_change":"2021-01-28T04:11:20.671937+0000","last_active":"2021-01-28T04:12:20.980229+0000","last_peered":"2021-01-28T04:12:20.980229+0000","last_clean":"2021-01-28T04:12:20.980229+0000","last_became_active":"2021-01-28T04:11:20.671509+0000","last_became_peered":"2021-01-28T04:11:20.671509+0000","last_unstale":"2021-01-28T04:12:20.980229+0000","last_undegraded":"2021-01-28T04:12:20.980229+0000","last_fullsized":"2021-01-28T04:12:20.980229+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,0],"acting":[5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"55'2","reported_seq":"53","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.786478+0000","last_change":"2021-01-28T04:11:17.634239+0000","last_active":"2021-01-28T04:14:08.786478+0000","last_peered":"2021-01-28T04:14:08.786478+0000","last_clean":"2021-01-28T04:14:08.786478+0000","last_became_active":"2021-01-28T04:11:17.633842+0000","last_became_peered":"2021-01-28T04:11:17.633842+0000","last_unstale":"2021-01-28T04:14:08.786478+0000","last_undegraded":"2021-01-28T04:14:08.786478+0000","last_fullsized":"2021-01-28T04:14:08.786478+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,0],"acting":[4,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"50'1","reported_seq":"38","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976790+0000","last_change":"2021-01-28T04:10:59.351434+0000","last_active":"2021-01-28T04:12:20.976790+0000","last_peered":"2021-01-28T04:12:20.976790+0000","last_clean":"2021-01-28T04:12:20.976790+0000","last_became_active":"2021-01-28T04:10:59.350943+0000","last_became_peered":"2021-01-28T04:10:59.350943+0000","last_unstale":"2021-01-28T04:12:20.976790+0000","last_undegraded":"2021-01-28T04:12:20.976790+0000","last_fullsized":"2021-01-28T04:12:20.976790+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":846,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"60'17","reported_seq":"46","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978820+0000","last_change":"2021-01-28T04:11:15.618449+0000","last_active":"2021-01-28T04:12:20.978820+0000","last_peered":"2021-01-28T04:12:20.978820+0000","last_clean":"2021-01-28T04:12:20.978820+0000","last_became_active":"2021-01-28T04:11:15.618022+0000","last_became_peered":"2021-01-28T04:11:15.618022+0000","last_unstale":"2021-01-28T04:12:20.978820+0000","last_undegraded":"2021-01-28T04:12:20.978820+0000","last_fullsized":"2021-01-28T04:12:20.978820+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":17,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":422,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.986637+0000","last_change":"2021-01-28T04:11:20.674593+0000","last_active":"2021-01-28T04:12:20.986637+0000","last_peered":"2021-01-28T04:12:20.986637+0000","last_clean":"2021-01-28T04:12:20.986637+0000","last_became_active":"2021-01-28T04:11:20.674065+0000","last_became_peered":"2021-01-28T04:11:20.674065+0000","last_unstale":"2021-01-28T04:12:20.986637+0000","last_undegraded":"2021-01-28T04:12:20.986637+0000","last_fullsized":"2021-01-28T04:12:20.986637+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2],"acting":[4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"55'2","reported_seq":"53","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.784936+0000","last_change":"2021-01-28T04:11:17.617328+0000","last_active":"2021-01-28T04:14:08.784936+0000","last_peered":"2021-01-28T04:14:08.784936+0000","last_clean":"2021-01-28T04:14:08.784936+0000","last_became_active":"2021-01-28T04:11:17.616919+0000","last_became_peered":"2021-01-28T04:11:17.616919+0000","last_unstale":"2021-01-28T04:14:08.784936+0000","last_undegraded":"2021-01-28T04:14:08.784936+0000","last_fullsized":"2021-01-28T04:14:08.784936+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,5],"acting":[2,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.a","version":"50'3","reported_seq":"43","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976585+0000","last_change":"2021-01-28T04:10:59.404378+0000","last_active":"2021-01-28T04:12:20.976585+0000","last_peered":"2021-01-28T04:12:20.976585+0000","last_clean":"2021-01-28T04:12:20.976585+0000","last_became_active":"2021-01-28T04:10:59.350378+0000","last_became_peered":"2021-01-28T04:10:59.350378+0000","last_unstale":"2021-01-28T04:12:20.976585+0000","last_undegraded":"2021-01-28T04:12:20.976585+0000","last_fullsized":"2021-01-28T04:12:20.976585+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":116,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":70,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7],"acting":[1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"60'13","reported_seq":"38","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.985760+0000","last_change":"2021-01-28T04:11:15.617499+0000","last_active":"2021-01-28T04:12:20.985760+0000","last_peered":"2021-01-28T04:12:20.985760+0000","last_clean":"2021-01-28T04:12:20.985760+0000","last_became_active":"2021-01-28T04:11:15.617126+0000","last_became_peered":"2021-01-28T04:11:15.617126+0000","last_unstale":"2021-01-28T04:12:20.985760+0000","last_undegraded":"2021-01-28T04:12:20.985760+0000","last_fullsized":"2021-01-28T04:12:20.985760+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":468,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":24,"num_read_kb":13,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976805+0000","last_change":"2021-01-28T04:11:20.673956+0000","last_active":"2021-01-28T04:12:20.976805+0000","last_peered":"2021-01-28T04:12:20.976805+0000","last_clean":"2021-01-28T04:12:20.976805+0000","last_became_active":"2021-01-28T04:11:20.673557+0000","last_became_peered":"2021-01-28T04:11:20.673557+0000","last_unstale":"2021-01-28T04:12:20.976805+0000","last_undegraded":"2021-01-28T04:12:20.976805+0000","last_fullsized":"2021-01-28T04:12:20.976805+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.977930+0000","last_change":"2021-01-28T04:11:17.625431+0000","last_active":"2021-01-28T04:12:20.977930+0000","last_peered":"2021-01-28T04:12:20.977930+0000","last_clean":"2021-01-28T04:12:20.977930+0000","last_became_active":"2021-01-28T04:11:17.625081+0000","last_became_peered":"2021-01-28T04:11:17.625081+0000","last_unstale":"2021-01-28T04:12:20.977930+0000","last_undegraded":"2021-01-28T04:12:20.977930+0000","last_fullsized":"2021-01-28T04:12:20.977930+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":"21","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.984667+0000","last_change":"2021-01-28T04:10:59.360986+0000","last_active":"2021-01-28T04:12:20.984667+0000","last_peered":"2021-01-28T04:12:20.984667+0000","last_clean":"2021-01-28T04:12:20.984667+0000","last_became_active":"2021-01-28T04:10:59.360542+0000","last_became_peered":"2021-01-28T04:10:59.360542+0000","last_unstale":"2021-01-28T04:12:20.984667+0000","last_undegraded":"2021-01-28T04:12:20.984667+0000","last_fullsized":"2021-01-28T04:12:20.984667+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,5],"acting":[7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"60'21","reported_seq":"53","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.988263+0000","last_change":"2021-01-28T04:11:15.620097+0000","last_active":"2021-01-28T04:12:20.988263+0000","last_peered":"2021-01-28T04:12:20.988263+0000","last_clean":"2021-01-28T04:12:20.988263+0000","last_became_active":"2021-01-28T04:11:15.619227+0000","last_became_peered":"2021-01-28T04:11:15.619227+0000","last_unstale":"2021-01-28T04:12:20.988263+0000","last_undegraded":"2021-01-28T04:12:20.988263+0000","last_fullsized":"2021-01-28T04:12:20.988263+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":21,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":734,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":41,"num_read_kb":23,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":"12","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.981645+0000","last_change":"2021-01-28T04:11:20.678936+0000","last_active":"2021-01-28T04:12:20.981645+0000","last_peered":"2021-01-28T04:12:20.981645+0000","last_clean":"2021-01-28T04:12:20.981645+0000","last_became_active":"2021-01-28T04:11:20.678284+0000","last_became_peered":"2021-01-28T04:11:20.678284+0000","last_unstale":"2021-01-28T04:12:20.981645+0000","last_undegraded":"2021-01-28T04:12:20.981645+0000","last_fullsized":"2021-01-28T04:12:20.981645+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.975767+0000","last_change":"2021-01-28T04:11:17.632051+0000","last_active":"2021-01-28T04:12:20.975767+0000","last_peered":"2021-01-28T04:12:20.975767+0000","last_clean":"2021-01-28T04:12:20.975767+0000","last_became_active":"2021-01-28T04:11:17.631547+0000","last_became_peered":"2021-01-28T04:11:17.631547+0000","last_unstale":"2021-01-28T04:12:20.975767+0000","last_undegraded":"2021-01-28T04:12:20.975767+0000","last_fullsized":"2021-01-28T04:12:20.975767+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"25","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.976286+0000","last_change":"2021-01-28T04:10:54.302190+0000","last_active":"2021-01-28T04:12:20.976286+0000","last_peered":"2021-01-28T04:12:20.976286+0000","last_clean":"2021-01-28T04:12:20.976286+0000","last_became_active":"2021-01-28T04:10:54.301697+0000","last_became_peered":"2021-01-28T04:10:54.301697+0000","last_unstale":"2021-01-28T04:12:20.976286+0000","last_undegraded":"2021-01-28T04:12:20.976286+0000","last_fullsized":"2021-01-28T04:12:20.976286+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0],"acting":[2,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"60'29","reported_seq":"111","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:12:22.021318+0000","last_change":"2021-01-28T04:12:22.021318+0000","last_active":"2021-01-28T04:12:22.021318+0000","last_peered":"2021-01-28T04:12:22.021318+0000","last_clean":"2021-01-28T04:12:22.021318+0000","last_became_active":"2021-01-28T04:12:21.993153+0000","last_became_peered":"2021-01-28T04:12:21.993153+0000","last_unstale":"2021-01-28T04:12:22.021318+0000","last_undegraded":"2021-01-28T04:12:22.021318+0000","last_fullsized":"2021-01-28T04:12:22.021318+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":29,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":732,"num_objects":14,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":56,"num_read_kb":36,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":732,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,7],"acting":[6,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.966636+0000","last_change":"2021-01-28T04:11:20.670962+0000","last_active":"2021-01-28T04:12:20.966636+0000","last_peered":"2021-01-28T04:12:20.966636+0000","last_clean":"2021-01-28T04:12:20.966636+0000","last_became_active":"2021-01-28T04:11:20.670561+0000","last_became_peered":"2021-01-28T04:11:20.670561+0000","last_unstale":"2021-01-28T04:12:20.966636+0000","last_undegraded":"2021-01-28T04:12:20.966636+0000","last_fullsized":"2021-01-28T04:12:20.966636+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,2],"acting":[0,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":"15","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.975938+0000","last_change":"2021-01-28T04:11:17.633611+0000","last_active":"2021-01-28T04:12:20.975938+0000","last_peered":"2021-01-28T04:12:20.975938+0000","last_clean":"2021-01-28T04:12:20.975938+0000","last_became_active":"2021-01-28T04:11:17.633272+0000","last_became_peered":"2021-01-28T04:11:17.633272+0000","last_unstale":"2021-01-28T04:12:20.975938+0000","last_undegraded":"2021-01-28T04:12:20.975938+0000","last_fullsized":"2021-01-28T04:12:20.975938+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"50'3","reported_seq":"32","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978391+0000","last_change":"2021-01-28T04:10:54.309741+0000","last_active":"2021-01-28T04:12:20.978391+0000","last_peered":"2021-01-28T04:12:20.978391+0000","last_clean":"2021-01-28T04:12:20.978391+0000","last_became_active":"2021-01-28T04:10:54.309363+0000","last_became_peered":"2021-01-28T04:10:54.309363+0000","last_unstale":"2021-01-28T04:12:20.978391+0000","last_undegraded":"2021-01-28T04:12:20.978391+0000","last_fullsized":"2021-01-28T04:12:20.978391+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":437,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3],"acting":[1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"60'20","reported_seq":"59","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.969333+0000","last_change":"2021-01-28T04:11:15.627829+0000","last_active":"2021-01-28T04:12:20.969333+0000","last_peered":"2021-01-28T04:12:20.969333+0000","last_clean":"2021-01-28T04:12:20.969333+0000","last_became_active":"2021-01-28T04:11:15.627397+0000","last_became_peered":"2021-01-28T04:11:15.627397+0000","last_unstale":"2021-01-28T04:12:20.969333+0000","last_undegraded":"2021-01-28T04:12:20.969333+0000","last_fullsized":"2021-01-28T04:12:20.969333+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":20,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":894,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":44,"num_read_kb":27,"num_write":21,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":"13","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978561+0000","last_change":"2021-01-28T04:11:20.761947+0000","last_active":"2021-01-28T04:12:20.978561+0000","last_peered":"2021-01-28T04:12:20.978561+0000","last_clean":"2021-01-28T04:12:20.978561+0000","last_became_active":"2021-01-28T04:11:20.761284+0000","last_became_peered":"2021-01-28T04:11:20.761284+0000","last_unstale":"2021-01-28T04:12:20.978561+0000","last_undegraded":"2021-01-28T04:12:20.978561+0000","last_fullsized":"2021-01-28T04:12:20.978561+0000","mapping_epoch":57,"log_start":"0'0","ondisk_log_start":"0'0","created":57,"last_epoch_clean":58,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:19.632989+0000","last_clean_scrub_stamp":"2021-01-28T04:11:19.632989+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":"43","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:12:21.990529+0000","last_change":"2021-01-28T04:12:21.990529+0000","last_active":"2021-01-28T04:12:21.990529+0000","last_peered":"2021-01-28T04:12:21.990529+0000","last_clean":"2021-01-28T04:12:21.990529+0000","last_became_active":"2021-01-28T04:12:21.990053+0000","last_became_peered":"2021-01-28T04:12:21.990053+0000","last_unstale":"2021-01-28T04:12:21.990529+0000","last_undegraded":"2021-01-28T04:12:21.990529+0000","last_fullsized":"2021-01-28T04:12:21.990529+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:10:53.265491+0000","last_clean_scrub_stamp":"2021-01-28T04:10:53.265491+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"60'30","reported_seq":"79","reported_epoch":"61","state":"active+clean","last_fresh":"2021-01-28T04:12:20.978400+0000","last_change":"2021-01-28T04:11:15.627522+0000","last_active":"2021-01-28T04:12:20.978400+0000","last_peered":"2021-01-28T04:12:20.978400+0000","last_clean":"2021-01-28T04:12:20.978400+0000","last_became_active":"2021-01-28T04:11:15.627063+0000","last_became_peered":"2021-01-28T04:11:15.627063+0000","last_unstale":"2021-01-28T04:12:20.978400+0000","last_undegraded":"2021-01-28T04:12:20.978400+0000","last_fullsized":"2021-01-28T04:12:20.978400+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":52,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:14.579725+0000","last_clean_scrub_stamp":"2021-01-28T04:11:14.579725+0000","log_size":30,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":578,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":59,"num_read_kb":42,"num_write":31,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"55'2","reported_seq":"53","reported_epoch":"62","state":"active+clean","last_fresh":"2021-01-28T04:14:08.786525+0000","last_change":"2021-01-28T04:11:17.631393+0000","last_active":"2021-01-28T04:14:08.786525+0000","last_peered":"2021-01-28T04:14:08.786525+0000","last_clean":"2021-01-28T04:14:08.786525+0000","last_became_active":"2021-01-28T04:11:17.631001+0000","last_became_peered":"2021-01-28T04:11:17.631001+0000","last_unstale":"2021-01-28T04:14:08.786525+0000","last_undegraded":"2021-01-28T04:14:08.786525+0000","last_fullsized":"2021-01-28T04:14:08.786525+0000","mapping_epoch":54,"log_start":"0'0","ondisk_log_start":"0'0","created":54,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-28T04:11:16.591831+0000","last_clean_scrub_stamp":"2021-01-28T04:11:16.591831+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4],"acting":[7,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":96,"acting":96,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":96,"acting":96,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":23524,"num_objects":335,"num_object_clones":0,"num_object_copies":1005,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":335,"num_whiteouts":0,"num_read":1452,"num_read_kb":925,"num_write":734,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":2114,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1966080,"data_stored":70572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":703,"ondisk_log_size":703,"up":96,"acting":96,"num_store_stats":8},{"poolid":3,"num_pg":3,"stat_sum":{"num_bytes":389,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":171,"num_read_kb":166,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1167,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":9,"acting":9,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":7},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1945,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":21,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":172,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":5835,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":96,"acting":96,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":49,"seq":210453397547,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6288,"kb_used_data":840,"kb_used_omap":0,"kb_used_meta":5440,"kb_avail":93738864,"statfs":{"total":95995035648,"available":95988596736,"internally_reserved":0,"allocated":860160,"data_stored":292847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5570560},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":1.873,"5min":1.968,"15min":1.9630000000000001},"min":{"1min":1.3360000000000001,"5min":1.1160000000000001,"15min":1.1160000000000001},"max":{"1min":2.895,"5min":3.5529999999999999,"15min":3.5529999999999999},"last":3.1299999999999999},{"interface":"front","average":{"1min":2.2679999999999998,"5min":2.2200000000000002,"15min":2.2509999999999999},"min":{"1min":1.46,"5min":0.87,"15min":0.87},"max":{"1min":3.2770000000000001,"5min":6.3659999999999997,"15min":6.3659999999999997},"last":1.8300000000000001}]},{"osd":1,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":2.2040000000000002,"5min":2.3620000000000001,"15min":2.4239999999999999},"min":{"1min":1.288,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":3.7269999999999999,"5min":6.7050000000000001,"15min":6.7050000000000001},"last":2.48},{"interface":"front","average":{"1min":2.2090000000000001,"5min":2.0779999999999998,"15min":2.0390000000000001},"min":{"1min":1.4179999999999999,"5min":1.03,"15min":1.03},"max":{"1min":3.351,"5min":3.351,"15min":3.351},"last":1.601}]},{"osd":2,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":2.613,"5min":2.4750000000000001,"15min":2.4430000000000001},"min":{"1min":1.3919999999999999,"5min":1.121,"15min":1.121},"max":{"1min":5.5019999999999998,"5min":5.5019999999999998,"15min":5.5019999999999998},"last":1.915},{"interface":"front","average":{"1min":2.6960000000000002,"5min":2.7440000000000002,"15min":2.7629999999999999},"min":{"1min":1.349,"5min":1.349,"15min":1.349},"max":{"1min":3.8149999999999999,"5min":5.0300000000000002,"15min":5.0300000000000002},"last":2.177}]},{"osd":3,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":2.7719999999999998,"5min":2.7389999999999999,"15min":2.7050000000000001},"min":{"1min":1.518,"5min":1.518,"15min":1.518},"max":{"1min":4.556,"5min":4.702,"15min":4.702},"last":2.5489999999999999},{"interface":"front","average":{"1min":2.8769999999999998,"5min":3.0009999999999999,"15min":3.0489999999999999},"min":{"1min":2.2749999999999999,"5min":1.4570000000000001,"15min":1.4570000000000001},"max":{"1min":4.2160000000000002,"5min":5.7149999999999999,"15min":5.7149999999999999},"last":2.9590000000000001}]},{"osd":4,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":2.6000000000000001,"5min":2.706,"15min":2.7719999999999998},"min":{"1min":1.175,"5min":1.175,"15min":1.175},"max":{"1min":4.6909999999999998,"5min":4.6909999999999998,"15min":4.6909999999999998},"last":2.0630000000000002},{"interface":"front","average":{"1min":3.1190000000000002,"5min":3.2170000000000001,"15min":3.2490000000000001},"min":{"1min":1.8700000000000001,"5min":1.254,"15min":1.254},"max":{"1min":4.3150000000000004,"5min":5.6289999999999996,"15min":5.6289999999999996},"last":2.8809999999999998}]},{"osd":5,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":3.4279999999999999,"5min":3.3980000000000001,"15min":3.4329999999999998},"min":{"1min":2.427,"5min":1.2929999999999999,"15min":1.2929999999999999},"max":{"1min":4.7629999999999999,"5min":6.9969999999999999,"15min":6.9969999999999999},"last":2.6819999999999999},{"interface":"front","average":{"1min":3.2759999999999998,"5min":3.129,"15min":3.1139999999999999},"min":{"1min":1.798,"5min":1.3460000000000001,"15min":1.3460000000000001},"max":{"1min":6.625,"5min":6.625,"15min":6.625},"last":2.4159999999999999}]},{"osd":6,"last update":"Thu Jan 28 04:14:03 2021","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":3.298,"15min":3.2850000000000001},"min":{"1min":2.1349999999999998,"5min":1.2509999999999999,"15min":1.2509999999999999},"max":{"1min":7.0540000000000003,"5min":7.0540000000000003,"15min":7.0540000000000003},"last":2.7959999999999998},{"interface":"front","average":{"1min":3.4980000000000002,"5min":3.5179999999999998,"15min":3.52},"min":{"1min":2.1019999999999999,"5min":1.956,"15min":1.956},"max":{"1min":4.4029999999999996,"5min":6.6219999999999999,"15min":6.6219999999999999},"last":3.3399999999999999}]}]},{"osd":6,"up_from":41,"seq":176093659185,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6396,"kb_used_data":884,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738756,"statfs":{"total":95995035648,"available":95988486144,"internally_reserved":0,"allocated":905216,"data_stored":294639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.1160000000000001,"5min":1.9650000000000001,"15min":1.9570000000000001},"min":{"1min":1.492,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":3.2330000000000001,"5min":3.476,"15min":3.476},"last":1.744},{"interface":"front","average":{"1min":2.1829999999999998,"5min":2.0379999999999998,"15min":2.0099999999999998},"min":{"1min":1.615,"5min":1.4430000000000001,"15min":1.4430000000000001},"max":{"1min":3.2389999999999999,"5min":3.2389999999999999,"15min":3.2389999999999999},"last":2.9489999999999998}]},{"osd":1,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.145,"5min":2.141,"15min":2.109},"min":{"1min":1.54,"5min":1.3740000000000001,"15min":1.3740000000000001},"max":{"1min":3.0409999999999999,"5min":3.4809999999999999,"15min":3.4809999999999999},"last":2.8340000000000001},{"interface":"front","average":{"1min":2.6829999999999998,"5min":2.3679999999999999,"15min":2.262},"min":{"1min":1.675,"5min":1.5529999999999999,"15min":1.5529999999999999},"max":{"1min":3.4489999999999998,"5min":3.4489999999999998,"15min":3.4489999999999998},"last":2.2759999999999998}]},{"osd":2,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.4119999999999999,"5min":2.4460000000000002,"15min":2.4260000000000002},"min":{"1min":1.4670000000000001,"5min":1.4670000000000001,"15min":1.4670000000000001},"max":{"1min":3.2240000000000002,"5min":3.5070000000000001,"15min":3.5070000000000001},"last":3.0790000000000002},{"interface":"front","average":{"1min":2.7229999999999999,"5min":2.6190000000000002,"15min":2.5790000000000002},"min":{"1min":1.786,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":3.6269999999999998,"5min":4.8239999999999998,"15min":4.8239999999999998},"last":2.1709999999999998}]},{"osd":3,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.4710000000000001,"5min":2.4649999999999999,"15min":2.4529999999999998},"min":{"1min":1.726,"5min":1.4219999999999999,"15min":1.4219999999999999},"max":{"1min":3.1200000000000001,"5min":3.601,"15min":3.601},"last":2.4430000000000001},{"interface":"front","average":{"1min":3.1099999999999999,"5min":2.944,"15min":2.9009999999999998},"min":{"1min":2.262,"5min":1.806,"15min":1.806},"max":{"1min":3.9079999999999999,"5min":3.9079999999999999,"15min":3.9079999999999999},"last":2.6680000000000001}]},{"osd":4,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":2.8199999999999998,"5min":2.911,"15min":2.9180000000000001},"min":{"1min":1.617,"5min":1.1539999999999999,"15min":1.1539999999999999},"max":{"1min":3.6309999999999998,"5min":5.1429999999999998,"15min":5.1429999999999998},"last":3.351},{"interface":"front","average":{"1min":2.8610000000000002,"5min":2.9180000000000001,"15min":2.9119999999999999},"min":{"1min":2.153,"5min":1.581,"15min":1.581},"max":{"1min":3.7610000000000001,"5min":4.4119999999999999,"15min":4.4119999999999999},"last":3.4500000000000002}]},{"osd":5,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":3.3079999999999998,"5min":3.2010000000000001,"15min":3.1880000000000002},"min":{"1min":2.4660000000000002,"5min":1.4870000000000001,"15min":1.4870000000000001},"max":{"1min":3.8919999999999999,"5min":5.4000000000000004,"15min":5.4000000000000004},"last":3.7389999999999999},{"interface":"front","average":{"1min":3.3610000000000002,"5min":3.1480000000000001,"15min":3.0920000000000001},"min":{"1min":2.0019999999999998,"5min":1.532,"15min":1.532},"max":{"1min":4.6420000000000003,"5min":4.6420000000000003,"15min":4.6420000000000003},"last":3.2050000000000001}]},{"osd":7,"last update":"Thu Jan 28 04:14:04 2021","interfaces":[{"interface":"back","average":{"1min":3.8300000000000001,"5min":3.6240000000000001,"15min":3.6019999999999999},"min":{"1min":3.2410000000000001,"5min":1.5680000000000001,"15min":1.5680000000000001},"max":{"1min":5.3529999999999998,"5min":5.6539999999999999,"15min":5.6539999999999999},"last":4.1420000000000003},{"interface":"front","average":{"1min":3.722,"5min":3.5960000000000001,"15min":3.6240000000000001},"min":{"1min":3.153,"5min":1.9350000000000001,"15min":1.9350000000000001},"max":{"1min":4.4900000000000002,"5min":4.9870000000000001,"15min":4.9870000000000001},"last":3.681}]}]},{"osd":1,"up_from":16,"seq":68719476814,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6880,"kb_used_data":984,"kb_used_omap":0,"kb_used_meta":5888,"kb_avail":93738272,"statfs":{"total":95995035648,"available":95987990528,"internally_reserved":0,"allocated":1007616,"data_stored":298861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6029312},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:13:12 2021","interfaces":[{"interface":"back","average":{"1min":1.964,"5min":1.7629999999999999,"15min":1.4470000000000001},"min":{"1min":1.244,"5min":0.745,"15min":0.745},"max":{"1min":2.77,"5min":2.77,"15min":2.77},"last":1.772},{"interface":"front","average":{"1min":1.9830000000000001,"5min":1.893,"15min":1.583},"min":{"1min":1.264,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":2.8559999999999999,"5min":3.1869999999999998,"15min":3.1869999999999998},"last":2.29}]},{"osd":2,"last update":"Thu Jan 28 04:13:49 2021","interfaces":[{"interface":"back","average":{"1min":2.484,"5min":2.4049999999999998,"15min":2.1360000000000001},"min":{"1min":1.042,"5min":0.85899999999999999,"15min":0.85899999999999999},"max":{"1min":3.1699999999999999,"5min":3.7730000000000001,"15min":3.7730000000000001},"last":1.673},{"interface":"front","average":{"1min":2.3330000000000002,"5min":2.3239999999999998,"15min":2.1829999999999998},"min":{"1min":1.4470000000000001,"5min":1.1890000000000001,"15min":1.1890000000000001},"max":{"1min":3.0070000000000001,"5min":3.3690000000000002,"15min":3.3690000000000002},"last":1.5669999999999999}]},{"osd":3,"last update":"Thu Jan 28 04:14:09 2021","interfaces":[{"interface":"back","average":{"1min":2.3420000000000001,"5min":2.194,"15min":2.0800000000000001},"min":{"1min":1.6160000000000001,"5min":1.27,"15min":1.27},"max":{"1min":4.226,"5min":4.226,"15min":4.226},"last":2.621},{"interface":"front","average":{"1min":2.823,"5min":2.621,"15min":2.419},"min":{"1min":1.6859999999999999,"5min":1.2270000000000001,"15min":1.2270000000000001},"max":{"1min":4.7309999999999999,"5min":4.7309999999999999,"15min":4.7309999999999999},"last":1.923}]},{"osd":4,"last update":"Thu Jan 28 04:13:35 2021","interfaces":[{"interface":"back","average":{"1min":2.964,"5min":2.8969999999999998,"15min":2.7549999999999999},"min":{"1min":1.7549999999999999,"5min":1.7549999999999999,"15min":1.7549999999999999},"max":{"1min":4.673,"5min":4.8769999999999998,"15min":4.8769999999999998},"last":2.7330000000000001},{"interface":"front","average":{"1min":3.1960000000000002,"5min":3.1219999999999999,"15min":2.9159999999999999},"min":{"1min":2.4329999999999998,"5min":2.093,"15min":2.093},"max":{"1min":4.1550000000000002,"5min":5.4779999999999998,"15min":5.4779999999999998},"last":2.23}]},{"osd":5,"last update":"Thu Jan 28 04:14:06 2021","interfaces":[{"interface":"back","average":{"1min":3.3260000000000001,"5min":3.1419999999999999,"15min":3.0299999999999998},"min":{"1min":1.617,"5min":1.617,"15min":1.617},"max":{"1min":5.2030000000000003,"5min":5.2030000000000003,"15min":5.2030000000000003},"last":3.198},{"interface":"front","average":{"1min":2.919,"5min":2.9980000000000002,"15min":2.9420000000000002},"min":{"1min":1.5489999999999999,"5min":1.5489999999999999,"15min":1.5489999999999999},"max":{"1min":3.9460000000000002,"5min":5.4130000000000003,"15min":5.4130000000000003},"last":3.2440000000000002}]},{"osd":6,"last update":"Thu Jan 28 04:13:35 2021","interfaces":[{"interface":"back","average":{"1min":3.4089999999999998,"5min":3.4620000000000002,"15min":3.4540000000000002},"min":{"1min":2.71,"5min":2.286,"15min":2.286},"max":{"1min":4.6130000000000004,"5min":5.7300000000000004,"15min":5.7300000000000004},"last":2.0739999999999998},{"interface":"front","average":{"1min":3.4940000000000002,"5min":3.6219999999999999,"15min":3.677},"min":{"1min":2.4079999999999999,"5min":1.859,"15min":1.859},"max":{"1min":4.968,"5min":4.968,"15min":4.968},"last":3.597}]},{"osd":7,"last update":"Thu Jan 28 04:14:06 2021","interfaces":[{"interface":"back","average":{"1min":3.3839999999999999,"5min":3.532,"15min":3.5990000000000002},"min":{"1min":2.2810000000000001,"5min":2.2810000000000001,"15min":2.2810000000000001},"max":{"1min":4.391,"5min":4.5010000000000003,"15min":4.5010000000000003},"last":3.6890000000000001},{"interface":"front","average":{"1min":4.0380000000000003,"5min":3.8210000000000002,"15min":3.8180000000000001},"min":{"1min":3.0760000000000001,"5min":2.0710000000000002,"15min":2.0710000000000002},"max":{"1min":5.8449999999999998,"5min":5.9939999999999998,"15min":5.9939999999999998},"last":2.395}]}]},{"osd":0,"up_from":10,"seq":42949673043,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6532,"kb_used_data":828,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738620,"statfs":{"total":95995035648,"available":95988346880,"internally_reserved":0,"allocated":847872,"data_stored":291864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 28 04:13:18 2021","interfaces":[{"interface":"back","average":{"1min":1.982,"5min":1.7589999999999999,"15min":1.494},"min":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":3.1640000000000001,"5min":3.1640000000000001,"15min":3.1640000000000001},"last":2.8519999999999999},{"interface":"front","average":{"1min":2.1629999999999998,"5min":1.867,"15min":1.5580000000000001},"min":{"1min":1.26,"5min":0.88100000000000001,"15min":0.88100000000000001},"max":{"1min":4.2629999999999999,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":5.008}]},{"osd":2,"last update":"Thu Jan 28 04:13:46 2021","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":2.0590000000000002,"15min":1.8680000000000001},"min":{"1min":1.3759999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"max":{"1min":5.6299999999999999,"5min":5.6299999999999999,"15min":5.6299999999999999},"last":5.4269999999999996},{"interface":"front","average":{"1min":2.9980000000000002,"5min":2.6909999999999998,"15min":2.3929999999999998},"min":{"1min":1.321,"5min":1.004,"15min":1.004},"max":{"1min":5.7439999999999998,"5min":5.7439999999999998,"15min":5.7439999999999998},"last":5.6390000000000002}]},{"osd":3,"last update":"Thu Jan 28 04:14:07 2021","interfaces":[{"interface":"back","average":{"1min":2.7050000000000001,"5min":2.492,"15min":2.2280000000000002},"min":{"1min":1.075,"5min":1.075,"15min":1.075},"max":{"1min":5.0490000000000004,"5min":5.0490000000000004,"15min":5.0490000000000004},"last":5.5250000000000004},{"interface":"front","average":{"1min":2.4929999999999999,"5min":2.444,"15min":2.3279999999999998},"min":{"1min":1.2310000000000001,"5min":1.2310000000000001,"15min":1.2310000000000001},"max":{"1min":3.194,"5min":3.6219999999999999,"15min":3.6219999999999999},"last":6.1699999999999999}]},{"osd":4,"last update":"Thu Jan 28 04:13:34 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":2.9950000000000001,"15min":2.9540000000000002},"min":{"1min":1.4770000000000001,"5min":1.4770000000000001,"15min":1.4770000000000001},"max":{"1min":4.2069999999999999,"5min":5.476,"15min":5.476},"last":5.3700000000000001},{"interface":"front","average":{"1min":2.7669999999999999,"5min":2.8330000000000002,"15min":2.738},"min":{"1min":1.73,"5min":1.73,"15min":1.73},"max":{"1min":5.3230000000000004,"5min":5.3230000000000004,"15min":5.3230000000000004},"last":6.5990000000000002}]},{"osd":5,"last update":"Thu Jan 28 04:14:07 2021","interfaces":[{"interface":"back","average":{"1min":3.3679999999999999,"5min":3.3130000000000002,"15min":3.2610000000000001},"min":{"1min":1.885,"5min":1.885,"15min":1.885},"max":{"1min":4.798,"5min":5.452,"15min":5.452},"last":6.9199999999999999},{"interface":"front","average":{"1min":3.3380000000000001,"5min":3.2850000000000001,"15min":3.2080000000000002},"min":{"1min":2.4620000000000002,"5min":2.0910000000000002,"15min":2.0910000000000002},"max":{"1min":4.8949999999999996,"5min":4.8949999999999996,"15min":4.8949999999999996},"last":4.1870000000000003}]},{"osd":6,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":3.464,"5min":3.4510000000000001,"15min":3.4289999999999998},"min":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"max":{"1min":5.7050000000000001,"5min":5.7050000000000001,"15min":5.7050000000000001},"last":7.2789999999999999},{"interface":"front","average":{"1min":3.327,"5min":3.3889999999999998,"15min":3.367},"min":{"1min":2.198,"5min":2.198,"15min":2.198},"max":{"1min":4.4349999999999996,"5min":4.4349999999999996,"15min":4.4349999999999996},"last":4.6210000000000004}]},{"osd":7,"last update":"Thu Jan 28 04:14:07 2021","interfaces":[{"interface":"back","average":{"1min":3.5939999999999999,"5min":3.6019999999999999,"15min":3.6040000000000001},"min":{"1min":1.609,"5min":1.609,"15min":1.609},"max":{"1min":4.7789999999999999,"5min":5.6239999999999997,"15min":5.6239999999999997},"last":3.702},{"interface":"front","average":{"1min":3.657,"5min":3.7160000000000002,"15min":3.7280000000000002},"min":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.9830000000000001},"max":{"1min":4.9850000000000003,"5min":5.8239999999999998,"15min":5.8239999999999998},"last":7.54}]}]},{"osd":2,"up_from":21,"seq":90194313288,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6296,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738856,"statfs":{"total":95995035648,"available":95988588544,"internally_reserved":0,"allocated":802816,"data_stored":290567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:13:40 2021","interfaces":[{"interface":"back","average":{"1min":2.29,"5min":1.921,"15min":1.7010000000000001},"min":{"1min":1.579,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":5.2789999999999999,"5min":5.2789999999999999,"15min":5.2789999999999999},"last":2.7949999999999999},{"interface":"front","average":{"1min":2.1549999999999998,"5min":2.1930000000000001,"15min":2.028},"min":{"1min":1.627,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":3.1920000000000002,"5min":9.6590000000000007,"15min":9.6590000000000007},"last":2.8610000000000002}]},{"osd":1,"last update":"Thu Jan 28 04:13:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5169999999999999,"5min":2.278,"15min":2.04},"min":{"1min":1.825,"5min":1.121,"15min":1.121},"max":{"1min":4.6399999999999997,"5min":5.1239999999999997,"15min":5.1239999999999997},"last":3.2759999999999998},{"interface":"front","average":{"1min":2.8260000000000001,"5min":2.4369999999999998,"15min":2.1459999999999999},"min":{"1min":2.1400000000000001,"5min":1.353,"15min":1.353},"max":{"1min":4.3220000000000001,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":3.706}]},{"osd":3,"last update":"Thu Jan 28 04:14:13 2021","interfaces":[{"interface":"back","average":{"1min":2.9049999999999998,"5min":2.7719999999999998,"15min":2.5880000000000001},"min":{"1min":1.9670000000000001,"5min":0.875,"15min":0.875},"max":{"1min":3.5720000000000001,"5min":5.5780000000000003,"15min":5.5780000000000003},"last":3.387},{"interface":"front","average":{"1min":2.702,"5min":2.7330000000000001,"15min":2.613},"min":{"1min":1.393,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":3.5019999999999998,"5min":6.2930000000000001,"15min":6.2930000000000001},"last":3.6070000000000002}]},{"osd":4,"last update":"Thu Jan 28 04:13:40 2021","interfaces":[{"interface":"back","average":{"1min":2.718,"5min":2.5630000000000002,"15min":2.5390000000000001},"min":{"1min":2.1150000000000002,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":6.0190000000000001,"5min":6.0960000000000001,"15min":6.0960000000000001},"last":2.9260000000000002},{"interface":"front","average":{"1min":3.3999999999999999,"5min":3.0390000000000001,"15min":2.8570000000000002},"min":{"1min":2.7360000000000002,"5min":1.9119999999999999,"15min":1.9119999999999999},"max":{"1min":6.1109999999999998,"5min":6.1109999999999998,"15min":6.1109999999999998},"last":4.1040000000000001}]},{"osd":5,"last update":"Thu Jan 28 04:14:06 2021","interfaces":[{"interface":"back","average":{"1min":3.3849999999999998,"5min":2.9359999999999999,"15min":2.8759999999999999},"min":{"1min":2.222,"5min":1.25,"15min":1.25},"max":{"1min":7.1900000000000004,"5min":7.1900000000000004,"15min":7.1900000000000004},"last":4.8620000000000001},{"interface":"front","average":{"1min":3.7629999999999999,"5min":3.4390000000000001,"15min":3.3029999999999999},"min":{"1min":3.1120000000000001,"5min":1.417,"15min":1.417},"max":{"1min":4.5270000000000001,"5min":6.4829999999999997,"15min":6.4829999999999997},"last":4.0359999999999996}]},{"osd":6,"last update":"Thu Jan 28 04:13:35 2021","interfaces":[{"interface":"back","average":{"1min":3.7360000000000002,"5min":3.5939999999999999,"15min":3.5569999999999999},"min":{"1min":3.2040000000000002,"5min":1.121,"15min":1.121},"max":{"1min":4.5469999999999997,"5min":5.7549999999999999,"15min":5.7549999999999999},"last":4.2949999999999999},{"interface":"front","average":{"1min":3.3889999999999998,"5min":3.3969999999999998,"15min":3.4350000000000001},"min":{"1min":2.5579999999999998,"5min":1.363,"15min":1.363},"max":{"1min":7.4420000000000002,"5min":7.4420000000000002,"15min":7.4420000000000002},"last":4.4509999999999996}]},{"osd":7,"last update":"Thu Jan 28 04:14:06 2021","interfaces":[{"interface":"back","average":{"1min":4.0490000000000004,"5min":3.952,"15min":3.944},"min":{"1min":3.0550000000000002,"5min":1.6259999999999999,"15min":1.6259999999999999},"max":{"1min":4.9390000000000001,"5min":7.3300000000000001,"15min":7.3300000000000001},"last":4.5439999999999996},{"interface":"front","average":{"1min":3.6560000000000001,"5min":3.5979999999999999,"15min":3.6440000000000001},"min":{"1min":3.0209999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"max":{"1min":5.8550000000000004,"5min":6.4130000000000003,"15min":6.4130000000000003},"last":4.3780000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149763,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6724,"kb_used_data":956,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738428,"statfs":{"total":95995035648,"available":95988150272,"internally_reserved":0,"allocated":978944,"data_stored":297440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:14:09 2021","interfaces":[{"interface":"back","average":{"1min":2.3969999999999998,"5min":2.0059999999999998,"15min":1.8260000000000001},"min":{"1min":1.5980000000000001,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":4.1790000000000003,"5min":4.1790000000000003,"15min":4.1790000000000003},"last":2.2069999999999999},{"interface":"front","average":{"1min":2.335,"5min":2.0800000000000001,"15min":1.9059999999999999},"min":{"1min":1.7010000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":4.5309999999999997,"5min":4.5309999999999997,"15min":4.5309999999999997},"last":2.1339999999999999}]},{"osd":1,"last update":"Thu Jan 28 04:14:09 2021","interfaces":[{"interface":"back","average":{"1min":2.4510000000000001,"5min":2.2130000000000001,"15min":2.069},"min":{"1min":1.696,"5min":1.0249999999999999,"15min":1.0249999999999999},"max":{"1min":4.8010000000000002,"5min":4.8010000000000002,"15min":4.8010000000000002},"last":2.7450000000000001},{"interface":"front","average":{"1min":2.9729999999999999,"5min":2.54,"15min":2.2090000000000001},"min":{"1min":2.254,"5min":0.88700000000000001,"15min":0.88700000000000001},"max":{"1min":4.4880000000000004,"5min":4.4880000000000004,"15min":4.4880000000000004},"last":2.6720000000000002}]},{"osd":2,"last update":"Thu Jan 28 04:14:09 2021","interfaces":[{"interface":"back","average":{"1min":2.9780000000000002,"5min":2.7469999999999999,"15min":2.4870000000000001},"min":{"1min":1.853,"5min":1.3720000000000001,"15min":1.3720000000000001},"max":{"1min":4.7240000000000002,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":2.903},{"interface":"front","average":{"1min":2.5209999999999999,"5min":2.343,"15min":2.2549999999999999},"min":{"1min":2.165,"5min":0.97299999999999998,"15min":0.97299999999999998},"max":{"1min":3.968,"5min":6.0330000000000004,"15min":6.0330000000000004},"last":2.2999999999999998}]},{"osd":4,"last update":"Thu Jan 28 04:13:34 2021","interfaces":[{"interface":"back","average":{"1min":3.0369999999999999,"5min":2.8599999999999999,"15min":2.7200000000000002},"min":{"1min":1.754,"5min":1.7170000000000001,"15min":1.7170000000000001},"max":{"1min":3.8980000000000001,"5min":5.4889999999999999,"15min":5.4889999999999999},"last":3.0150000000000001},{"interface":"front","average":{"1min":3.536,"5min":3.3319999999999999,"15min":3.1869999999999998},"min":{"1min":2.5499999999999998,"5min":1.8480000000000001,"15min":1.8480000000000001},"max":{"1min":5.5309999999999997,"5min":5.5309999999999997,"15min":5.5309999999999997},"last":3.1840000000000002}]},{"osd":5,"last update":"Thu Jan 28 04:14:04 2021","interfaces":[{"interface":"back","average":{"1min":3.2410000000000001,"5min":3.2010000000000001,"15min":3.1389999999999998},"min":{"1min":2.3660000000000001,"5min":1.472,"15min":1.472},"max":{"1min":5.202,"5min":5.202,"15min":5.202},"last":3.3359999999999999},{"interface":"front","average":{"1min":4.0659999999999998,"5min":3.7389999999999999,"15min":3.6269999999999998},"min":{"1min":3.2810000000000001,"5min":1.4399999999999999,"15min":1.4399999999999999},"max":{"1min":5.1589999999999998,"5min":5.5720000000000001,"15min":5.5720000000000001},"last":3.427}]},{"osd":6,"last update":"Thu Jan 28 04:13:30 2021","interfaces":[{"interface":"back","average":{"1min":3.6880000000000002,"5min":3.6339999999999999,"15min":3.5699999999999998},"min":{"1min":2.6779999999999999,"5min":2.0129999999999999,"15min":2.0129999999999999},"max":{"1min":5.1219999999999999,"5min":5.3600000000000003,"15min":5.3600000000000003},"last":3.6480000000000001},{"interface":"front","average":{"1min":3.069,"5min":2.8839999999999999,"15min":2.8039999999999998},"min":{"1min":1.9650000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"max":{"1min":4.3520000000000003,"5min":5.2290000000000001,"15min":5.2290000000000001},"last":3.702}]},{"osd":7,"last update":"Thu Jan 28 04:14:04 2021","interfaces":[{"interface":"back","average":{"1min":4.3310000000000004,"5min":4.0279999999999996,"15min":3.9420000000000002},"min":{"1min":3.4940000000000002,"5min":2.1360000000000001,"15min":2.1360000000000001},"max":{"1min":5.5309999999999997,"5min":6.1790000000000003,"15min":6.1790000000000003},"last":3.8740000000000001},{"interface":"front","average":{"1min":3.4140000000000001,"5min":3.2389999999999999,"15min":3.2000000000000002},"min":{"1min":2.5619999999999998,"5min":1.413,"15min":1.413},"max":{"1min":4.3369999999999997,"5min":5.6500000000000004,"15min":5.6500000000000004},"last":3.9420000000000002}]}]},{"osd":4,"up_from":31,"seq":133143986236,"num_pgs":53,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6544,"kb_used_data":904,"kb_used_omap":0,"kb_used_meta":5632,"kb_avail":93738608,"statfs":{"total":95995035648,"available":95988334592,"internally_reserved":0,"allocated":925696,"data_stored":294979,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5767168},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":1.984,"5min":1.984,"15min":1.9299999999999999},"min":{"1min":1.4770000000000001,"5min":1.2330000000000001,"15min":1.2330000000000001},"max":{"1min":2.694,"5min":5.9269999999999996,"15min":5.9269999999999996},"last":1.986},{"interface":"front","average":{"1min":2.0840000000000001,"5min":2.0859999999999999,"15min":2.1400000000000001},"min":{"1min":1.5069999999999999,"5min":1.2909999999999999,"15min":1.2909999999999999},"max":{"1min":3.214,"5min":6.7599999999999998,"15min":6.7599999999999998},"last":2.1040000000000001}]},{"osd":1,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":2.1080000000000001,"5min":2.0590000000000002,"15min":2.0150000000000001},"min":{"1min":1.538,"5min":1.3080000000000001,"15min":1.3080000000000001},"max":{"1min":3.0299999999999998,"5min":4.1130000000000004,"15min":4.1130000000000004},"last":2.2280000000000002},{"interface":"front","average":{"1min":2.585,"5min":2.3879999999999999,"15min":2.2320000000000002},"min":{"1min":1.6100000000000001,"5min":1.498,"15min":1.498},"max":{"1min":4.5609999999999999,"5min":4.5609999999999999,"15min":4.5609999999999999},"last":2.581}]},{"osd":2,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":2.536,"5min":2.5430000000000001,"15min":2.367},"min":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"max":{"1min":4.1500000000000004,"5min":4.8869999999999996,"15min":4.8869999999999996},"last":3.141},{"interface":"front","average":{"1min":2.7349999999999999,"5min":2.6080000000000001,"15min":2.4129999999999998},"min":{"1min":1.73,"5min":1.177,"15min":1.177},"max":{"1min":3.6219999999999999,"5min":4.734,"15min":4.734},"last":3.8260000000000001}]},{"osd":3,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":2.9500000000000002,"5min":2.7879999999999998,"15min":2.6920000000000002},"min":{"1min":2.5600000000000001,"5min":1.8220000000000001,"15min":1.8220000000000001},"max":{"1min":3.319,"5min":5.1710000000000003,"15min":5.1710000000000003},"last":4.1269999999999998},{"interface":"front","average":{"1min":2.7970000000000002,"5min":2.6949999999999998,"15min":2.54},"min":{"1min":2.1629999999999998,"5min":1.546,"15min":1.546},"max":{"1min":3.5910000000000002,"5min":4.0039999999999996,"15min":4.0039999999999996},"last":3.3279999999999998}]},{"osd":5,"last update":"Thu Jan 28 04:14:14 2021","interfaces":[{"interface":"back","average":{"1min":2.8839999999999999,"5min":2.8300000000000001,"15min":2.7170000000000001},"min":{"1min":2.0739999999999998,"5min":1.304,"15min":1.304},"max":{"1min":4.3239999999999998,"5min":4.6399999999999997,"15min":4.6399999999999997},"last":4.3239999999999998},{"interface":"front","average":{"1min":2.931,"5min":3.0150000000000001,"15min":2.8610000000000002},"min":{"1min":1.911,"5min":1.113,"15min":1.113},"max":{"1min":3.5680000000000001,"5min":5.125,"15min":5.125},"last":3.5680000000000001}]},{"osd":6,"last update":"Thu Jan 28 04:13:36 2021","interfaces":[{"interface":"back","average":{"1min":3.2519999999999998,"5min":3.4180000000000001,"15min":3.476},"min":{"1min":2.3580000000000001,"5min":2.0449999999999999,"15min":2.0449999999999999},"max":{"1min":4.0670000000000002,"5min":5.4249999999999998,"15min":5.4249999999999998},"last":4.4109999999999996},{"interface":"front","average":{"1min":3.4300000000000002,"5min":3.46,"15min":3.4540000000000002},"min":{"1min":2.3010000000000002,"5min":2.0699999999999998,"15min":2.0699999999999998},"max":{"1min":4.2439999999999998,"5min":4.5030000000000001,"15min":4.5030000000000001},"last":4.5650000000000004}]},{"osd":7,"last update":"Thu Jan 28 04:14:00 2021","interfaces":[{"interface":"back","average":{"1min":3.448,"5min":3.7930000000000001,"15min":3.8839999999999999},"min":{"1min":2.5590000000000002,"5min":2.4929999999999999,"15min":2.4929999999999999},"max":{"1min":4.4770000000000003,"5min":7.0979999999999999,"15min":7.0979999999999999},"last":4.7789999999999999},{"interface":"front","average":{"1min":3.5510000000000002,"5min":3.7269999999999999,"15min":3.827},"min":{"1min":2.867,"5min":1.8859999999999999,"15min":1.8859999999999999},"max":{"1min":4.2000000000000002,"5min":5.6360000000000001,"15min":5.6360000000000001},"last":4.617}]}]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6304,"kb_used_data":792,"kb_used_omap":0,"kb_used_meta":5504,"kb_avail":93738848,"statfs":{"total":95995035648,"available":95988580352,"internally_reserved":0,"allocated":811008,"data_stored":290641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5636096},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":2.0019999999999998,"5min":1.972,"15min":1.996},"min":{"1min":1.429,"5min":1.163,"15min":1.163},"max":{"1min":2.7749999999999999,"5min":4.0519999999999996,"15min":4.0519999999999996},"last":2.121},{"interface":"front","average":{"1min":2.1819999999999999,"5min":2.0270000000000001,"15min":1.9039999999999999},"min":{"1min":1.5660000000000001,"5min":1.4079999999999999,"15min":1.4079999999999999},"max":{"1min":4.0510000000000002,"5min":4.1980000000000004,"15min":4.1980000000000004},"last":2.3279999999999998}]},{"osd":1,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":2.286,"5min":2.0259999999999998,"15min":1.956},"min":{"1min":1.464,"5min":1.0880000000000001,"15min":1.0880000000000001},"max":{"1min":3.391,"5min":3.391,"15min":3.391},"last":1.8169999999999999},{"interface":"front","average":{"1min":2.238,"5min":2.2120000000000002,"15min":2.0649999999999999},"min":{"1min":1.429,"5min":0.96599999999999997,"15min":0.96599999999999997},"max":{"1min":3.306,"5min":4.9249999999999998,"15min":4.9249999999999998},"last":1.907}]},{"osd":2,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":2.5899999999999999,"5min":2.5,"15min":2.2799999999999998},"min":{"1min":1.7050000000000001,"5min":1.5409999999999999,"15min":1.5409999999999999},"max":{"1min":3.5750000000000002,"5min":5.0119999999999996,"15min":5.0119999999999996},"last":1.724},{"interface":"front","average":{"1min":2.589,"5min":2.456,"15min":2.2989999999999999},"min":{"1min":1.857,"5min":1.3779999999999999,"15min":1.3779999999999999},"max":{"1min":3.7669999999999999,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":2.4630000000000001}]},{"osd":3,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":3.0419999999999998,"5min":2.9089999999999998,"15min":2.681},"min":{"1min":1.379,"5min":1.379,"15min":1.379},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":4.9039999999999999},"last":3.3719999999999999},{"interface":"front","average":{"1min":3.0790000000000002,"5min":2.9910000000000001,"15min":2.7890000000000001},"min":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"max":{"1min":4.1689999999999996,"5min":5.0659999999999998,"15min":5.0659999999999998},"last":2.7770000000000001}]},{"osd":4,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":2.7949999999999999,"5min":2.6749999999999998,"15min":2.468},"min":{"1min":1.9490000000000001,"5min":1.0740000000000001,"15min":1.0740000000000001},"max":{"1min":3.7389999999999999,"5min":5.3049999999999997,"15min":5.3049999999999997},"last":2.8210000000000002},{"interface":"front","average":{"1min":3.3450000000000002,"5min":3.0990000000000002,"15min":2.7999999999999998},"min":{"1min":2.056,"5min":1.4379999999999999,"15min":1.4379999999999999},"max":{"1min":5.3079999999999998,"5min":5.3079999999999998,"15min":5.3079999999999998},"last":2.6850000000000001}]},{"osd":6,"last update":"Thu Jan 28 04:13:31 2021","interfaces":[{"interface":"back","average":{"1min":3.4369999999999998,"5min":3.3530000000000002,"15min":3.2549999999999999},"min":{"1min":2.2629999999999999,"5min":1.772,"15min":1.772},"max":{"1min":4.5209999999999999,"5min":5.2439999999999998,"15min":5.2439999999999998},"last":3.089},{"interface":"front","average":{"1min":3.2949999999999999,"5min":3.1850000000000001,"15min":3.125},"min":{"1min":2.6150000000000002,"5min":1.5960000000000001,"15min":1.5960000000000001},"max":{"1min":3.899,"5min":4.6550000000000002,"15min":4.6550000000000002},"last":2.9820000000000002}]},{"osd":7,"last update":"Thu Jan 28 04:14:05 2021","interfaces":[{"interface":"back","average":{"1min":3.8010000000000002,"5min":3.968,"15min":4.0679999999999996},"min":{"1min":3.2109999999999999,"5min":2.552,"15min":2.552},"max":{"1min":5.1970000000000001,"5min":5.5499999999999998,"15min":5.5499999999999998},"last":3.585},{"interface":"front","average":{"1min":3.4649999999999999,"5min":3.6150000000000002,"15min":3.6739999999999999},"min":{"1min":2.1560000000000001,"5min":1.1359999999999999,"15min":1.1359999999999999},"max":{"1min":4.6070000000000002,"5min":5.1630000000000003,"15min":5.1630000000000003},"last":3.1869999999999998}]}]}]}} 2021-01-28T04:14:21.619 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2021-01-28T04:14:21.622 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2021-01-28T04:14:21.623 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2021-01-28T04:14:21.624 DEBUG:teuthology.orchestra.run.smithi150:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:507028cb839c25d6666833702df6325fd8569096 shell --fsid d0bb049a-611d-11eb-8f9e-001a4aab830c -- ceph health --format=json 2021-01-28T04:14:21.774 INFO:teuthology.orchestra.run.smithi150.stderr:Inferring config /var/lib/ceph/d0bb049a-611d-11eb-8f9e-001a4aab830c/mon.a/config 2021-01-28T04:14:21.816 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:14:21 smithi150 bash[10146]: debug 2021-01-28T04:14:21.517+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:14:21.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:14:21 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:14:22.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:22 smithi150 bash[9867]: audit 2021-01-28T04:14:21.520345+0000 mgr.y (mgr.14138) 454 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:22.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:22 smithi150 bash[13629]: audit 2021-01-28T04:14:21.520345+0000 mgr.y (mgr.14138) 454 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:23.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:22 smithi134 bash[9858]: audit 2021-01-28T04:14:21.520345+0000 mgr.y (mgr.14138) 454 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:23.969 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:23 smithi150 bash[9867]: cluster 2021-01-28T04:14:22.958828+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:23.969 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:23 smithi150 bash[13629]: cluster 2021-01-28T04:14:22.958828+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:24.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:23 smithi134 bash[9858]: cluster 2021-01-28T04:14:22.958828+0000 mgr.y (mgr.14138) 455 : cluster [DBG] pgmap v323: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:25.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:25 smithi134 bash[9858]: cluster 2021-01-28T04:14:24.960027+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:25.466 INFO:teuthology.orchestra.run.smithi150.stdout: 2021-01-28T04:14:25.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:25 smithi150 bash[9867]: cluster 2021-01-28T04:14:24.960027+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:25.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:25 smithi150 bash[13629]: cluster 2021-01-28T04:14:24.960027+0000 mgr.y (mgr.14138) 456 : cluster [DBG] pgmap v324: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:26.255 INFO:teuthology.orchestra.run.smithi150.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2021-01-28T04:14:26.255 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2021-01-28T04:14:26.257 INFO:tasks.cephadm:Setup complete, yielding 2021-01-28T04:14:26.258 INFO:teuthology.run_tasks:Running task workunit... 2021-01-28T04:14:26.273 INFO:tasks.workunit:Pulling workunits from ref 507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:14:26.275 INFO:tasks.workunit:Making a separate scratch dir for every client... 2021-01-28T04:14:26.275 DEBUG:teuthology.orchestra.run.smithi150:> stat -- /home/ubuntu/cephtest/mnt.0 2021-01-28T04:14:26.283 INFO:teuthology.orchestra.run.smithi150.stderr:stat: cannot stat '/home/ubuntu/cephtest/mnt.0': No such file or directory 2021-01-28T04:14:26.283 DEBUG:teuthology.orchestra.run:got remote process result: 1 2021-01-28T04:14:26.284 DEBUG:teuthology.orchestra.run.smithi150:> mkdir -- /home/ubuntu/cephtest/mnt.0 2021-01-28T04:14:26.293 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2021-01-28T04:14:26.293 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2021-01-28T04:14:26.345 INFO:tasks.workunit:timeout=3h 2021-01-28T04:14:26.345 INFO:tasks.workunit:cleanup=True 2021-01-28T04:14:26.346 DEBUG:teuthology.orchestra.run.smithi150:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 507028cb839c25d6666833702df6325fd8569096 2021-01-28T04:14:26.354 INFO:tasks.workunit.client.0.smithi150.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2021-01-28T04:14:26.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:26 smithi134 bash[9858]: audit 2021-01-28T04:14:25.465920+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.150:0/583615277' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T04:14:26.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:26 smithi150 bash[9867]: audit 2021-01-28T04:14:25.465920+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.150:0/583615277' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T04:14:26.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:26 smithi150 bash[13629]: audit 2021-01-28T04:14:25.465920+0000 mon.c (mon.1) 29 : audit [DBG] from='client.? 172.21.15.150:0/583615277' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2021-01-28T04:14:27.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:27 smithi150 bash[9867]: cluster 2021-01-28T04:14:26.960857+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:27.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:27 smithi150 bash[13629]: cluster 2021-01-28T04:14:26.960857+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:28.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:27 smithi134 bash[9858]: cluster 2021-01-28T04:14:26.960857+0000 mgr.y (mgr.14138) 457 : cluster [DBG] pgmap v325: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:29.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:29 smithi134 bash[9858]: cluster 2021-01-28T04:14:28.962149+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:29.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:29 smithi150 bash[9867]: cluster 2021-01-28T04:14:28.962149+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:29.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:29 smithi150 bash[13629]: cluster 2021-01-28T04:14:28.962149+0000 mgr.y (mgr.14138) 458 : cluster [DBG] pgmap v326: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:31.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:31 smithi134 bash[9858]: cluster 2021-01-28T04:14:30.963118+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:31.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:31 smithi150 bash[9867]: cluster 2021-01-28T04:14:30.963118+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:31.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:31 smithi150 bash[13629]: cluster 2021-01-28T04:14:30.963118+0000 mgr.y (mgr.14138) 459 : cluster [DBG] pgmap v327: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:31.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:14:31 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:14:31.976 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:14:31 smithi150 bash[10146]: debug 2021-01-28T04:14:31.529+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:14:32.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:32 smithi150 bash[13629]: audit 2021-01-28T04:14:31.531823+0000 mgr.y (mgr.14138) 460 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:32.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:32 smithi150 bash[9867]: audit 2021-01-28T04:14:31.531823+0000 mgr.y (mgr.14138) 460 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:33.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:32 smithi134 bash[9858]: audit 2021-01-28T04:14:31.531823+0000 mgr.y (mgr.14138) 460 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:33.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:33 smithi150 bash[13629]: cluster 2021-01-28T04:14:32.964237+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:33.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:33 smithi150 bash[9867]: cluster 2021-01-28T04:14:32.964237+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:34.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:33 smithi134 bash[9858]: cluster 2021-01-28T04:14:32.964237+0000 mgr.y (mgr.14138) 461 : cluster [DBG] pgmap v328: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:35.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:35 smithi134 bash[9858]: cluster 2021-01-28T04:14:34.965415+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:35.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:35 smithi150 bash[13629]: cluster 2021-01-28T04:14:34.965415+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:35.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:35 smithi150 bash[9867]: cluster 2021-01-28T04:14:34.965415+0000 mgr.y (mgr.14138) 462 : cluster [DBG] pgmap v329: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:37.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:37 smithi150 bash[9867]: cluster 2021-01-28T04:14:36.966265+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:37.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:37 smithi150 bash[13629]: cluster 2021-01-28T04:14:36.966265+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:38.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:37 smithi134 bash[9858]: cluster 2021-01-28T04:14:36.966265+0000 mgr.y (mgr.14138) 463 : cluster [DBG] pgmap v330: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:39.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:39 smithi134 bash[9858]: cluster 2021-01-28T04:14:38.967631+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:39.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:39 smithi150 bash[9867]: cluster 2021-01-28T04:14:38.967631+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:39.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:39 smithi150 bash[13629]: cluster 2021-01-28T04:14:38.967631+0000 mgr.y (mgr.14138) 464 : cluster [DBG] pgmap v331: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:41.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:41 smithi134 bash[9858]: cluster 2021-01-28T04:14:40.968536+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:41.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:41 smithi150 bash[9867]: cluster 2021-01-28T04:14:40.968536+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:41.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:41 smithi150 bash[13629]: cluster 2021-01-28T04:14:40.968536+0000 mgr.y (mgr.14138) 465 : cluster [DBG] pgmap v332: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:41.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:14:41 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:14:41.976 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:14:41 smithi150 bash[10146]: debug 2021-01-28T04:14:41.537+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:14:42.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:42 smithi150 bash[13629]: audit 2021-01-28T04:14:41.541774+0000 mgr.y (mgr.14138) 466 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:42.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:42 smithi150 bash[9867]: audit 2021-01-28T04:14:41.541774+0000 mgr.y (mgr.14138) 466 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:43.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:42 smithi134 bash[9858]: audit 2021-01-28T04:14:41.541774+0000 mgr.y (mgr.14138) 466 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:43.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:43 smithi150 bash[13629]: cluster 2021-01-28T04:14:42.969646+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:43.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:43 smithi150 bash[9867]: cluster 2021-01-28T04:14:42.969646+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:44.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:43 smithi134 bash[9858]: cluster 2021-01-28T04:14:42.969646+0000 mgr.y (mgr.14138) 467 : cluster [DBG] pgmap v333: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:45.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:45 smithi134 bash[9858]: cluster 2021-01-28T04:14:44.970863+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:45.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:45 smithi150 bash[9867]: cluster 2021-01-28T04:14:44.970863+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:45.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:45 smithi150 bash[13629]: cluster 2021-01-28T04:14:44.970863+0000 mgr.y (mgr.14138) 468 : cluster [DBG] pgmap v334: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:47.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:47 smithi150 bash[13629]: cluster 2021-01-28T04:14:46.971706+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:47.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:47 smithi150 bash[9867]: cluster 2021-01-28T04:14:46.971706+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:48.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:47 smithi134 bash[9858]: cluster 2021-01-28T04:14:46.971706+0000 mgr.y (mgr.14138) 469 : cluster [DBG] pgmap v335: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:49.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:49 smithi134 bash[9858]: cluster 2021-01-28T04:14:48.973073+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:49.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:49 smithi150 bash[9867]: cluster 2021-01-28T04:14:48.973073+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:49.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:49 smithi150 bash[13629]: cluster 2021-01-28T04:14:48.973073+0000 mgr.y (mgr.14138) 470 : cluster [DBG] pgmap v336: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:51.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:51 smithi134 bash[9858]: cluster 2021-01-28T04:14:50.974045+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:51.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:51 smithi150 bash[9867]: cluster 2021-01-28T04:14:50.974045+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:51.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:51 smithi150 bash[13629]: cluster 2021-01-28T04:14:50.974045+0000 mgr.y (mgr.14138) 471 : cluster [DBG] pgmap v337: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:51.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:14:51 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:14:51.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:14:51 smithi150 bash[10146]: debug 2021-01-28T04:14:51.545+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:14:52.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:52 smithi150 bash[9867]: audit 2021-01-28T04:14:51.547750+0000 mgr.y (mgr.14138) 472 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:52.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:52 smithi150 bash[13629]: audit 2021-01-28T04:14:51.547750+0000 mgr.y (mgr.14138) 472 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:53.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:52 smithi134 bash[9858]: audit 2021-01-28T04:14:51.547750+0000 mgr.y (mgr.14138) 472 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:14:53.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:53 smithi150 bash[9867]: cluster 2021-01-28T04:14:52.975254+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:53.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:53 smithi150 bash[13629]: cluster 2021-01-28T04:14:52.975254+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:54.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:53 smithi134 bash[9858]: cluster 2021-01-28T04:14:52.975254+0000 mgr.y (mgr.14138) 473 : cluster [DBG] pgmap v338: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:55.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:55 smithi134 bash[9858]: cluster 2021-01-28T04:14:54.976491+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:55.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:55 smithi150 bash[9867]: cluster 2021-01-28T04:14:54.976491+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:55.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:55 smithi150 bash[13629]: cluster 2021-01-28T04:14:54.976491+0000 mgr.y (mgr.14138) 474 : cluster [DBG] pgmap v339: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:57.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:57 smithi150 bash[9867]: cluster 2021-01-28T04:14:56.977396+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:57.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:57 smithi150 bash[13629]: cluster 2021-01-28T04:14:56.977396+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:58.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:57 smithi134 bash[9858]: cluster 2021-01-28T04:14:56.977396+0000 mgr.y (mgr.14138) 475 : cluster [DBG] pgmap v340: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:14:59.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:14:59 smithi134 bash[9858]: cluster 2021-01-28T04:14:58.978786+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:59.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:14:59 smithi150 bash[9867]: cluster 2021-01-28T04:14:58.978786+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:14:59.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:14:59 smithi150 bash[13629]: cluster 2021-01-28T04:14:58.978786+0000 mgr.y (mgr.14138) 476 : cluster [DBG] pgmap v341: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:01.382 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:01 smithi150 bash[9867]: cluster 2021-01-28T04:15:00.979659+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:01.382 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:01 smithi150 bash[13629]: cluster 2021-01-28T04:15:00.979659+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:01.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:01 smithi134 bash[9858]: cluster 2021-01-28T04:15:00.979659+0000 mgr.y (mgr.14138) 477 : cluster [DBG] pgmap v342: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:01.725 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:15:01 smithi150 bash[10146]: debug 2021-01-28T04:15:01.557+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:15:01.822 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:15:01 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:15:02.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:02 smithi150 bash[13629]: audit 2021-01-28T04:15:01.559347+0000 mgr.y (mgr.14138) 478 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:02.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:02 smithi150 bash[9867]: audit 2021-01-28T04:15:01.559347+0000 mgr.y (mgr.14138) 478 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:03.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:02 smithi134 bash[9858]: audit 2021-01-28T04:15:01.559347+0000 mgr.y (mgr.14138) 478 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:03.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:03 smithi150 bash[9867]: cluster 2021-01-28T04:15:02.980868+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:03.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:03 smithi150 bash[13629]: cluster 2021-01-28T04:15:02.980868+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:04.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:03 smithi134 bash[9858]: cluster 2021-01-28T04:15:02.980868+0000 mgr.y (mgr.14138) 479 : cluster [DBG] pgmap v343: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:05.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:05 smithi134 bash[9858]: cluster 2021-01-28T04:15:04.982009+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:05.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:05 smithi150 bash[9867]: cluster 2021-01-28T04:15:04.982009+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:05.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:05 smithi150 bash[13629]: cluster 2021-01-28T04:15:04.982009+0000 mgr.y (mgr.14138) 480 : cluster [DBG] pgmap v344: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:07.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:07 smithi150 bash[9867]: cluster 2021-01-28T04:15:06.982897+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:07.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:07 smithi150 bash[13629]: cluster 2021-01-28T04:15:06.982897+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:08.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:07 smithi134 bash[9858]: cluster 2021-01-28T04:15:06.982897+0000 mgr.y (mgr.14138) 481 : cluster [DBG] pgmap v345: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:09.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:09 smithi134 bash[9858]: cluster 2021-01-28T04:15:08.984185+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:09.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:09 smithi150 bash[9867]: cluster 2021-01-28T04:15:08.984185+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:09.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:09 smithi150 bash[13629]: cluster 2021-01-28T04:15:08.984185+0000 mgr.y (mgr.14138) 482 : cluster [DBG] pgmap v346: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:11.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:11 smithi134 bash[9858]: cluster 2021-01-28T04:15:10.985002+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:11.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:11 smithi150 bash[9867]: cluster 2021-01-28T04:15:10.985002+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:11.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:11 smithi150 bash[13629]: cluster 2021-01-28T04:15:10.985002+0000 mgr.y (mgr.14138) 483 : cluster [DBG] pgmap v347: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:11.887 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:15:11 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:15:11.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:15:11 smithi150 bash[10146]: debug 2021-01-28T04:15:11.569+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:15:12.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:12 smithi150 bash[9867]: audit 2021-01-28T04:15:11.570334+0000 mgr.y (mgr.14138) 484 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:12.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:12 smithi150 bash[13629]: audit 2021-01-28T04:15:11.570334+0000 mgr.y (mgr.14138) 484 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:12 smithi134 bash[9858]: audit 2021-01-28T04:15:11.570334+0000 mgr.y (mgr.14138) 484 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:13.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:13 smithi150 bash[9867]: cluster 2021-01-28T04:15:12.986128+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:13.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:13 smithi150 bash[13629]: cluster 2021-01-28T04:15:12.986128+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:14.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:13 smithi134 bash[9858]: cluster 2021-01-28T04:15:12.986128+0000 mgr.y (mgr.14138) 485 : cluster [DBG] pgmap v348: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:15.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:15 smithi134 bash[9858]: cluster 2021-01-28T04:15:14.986952+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:15.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:15 smithi150 bash[9867]: cluster 2021-01-28T04:15:14.986952+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:15.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:15 smithi150 bash[13629]: cluster 2021-01-28T04:15:14.986952+0000 mgr.y (mgr.14138) 486 : cluster [DBG] pgmap v349: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:17.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:17 smithi150 bash[9867]: cluster 2021-01-28T04:15:16.987816+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:17.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:17 smithi150 bash[13629]: cluster 2021-01-28T04:15:16.987816+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:18.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:17 smithi134 bash[9858]: cluster 2021-01-28T04:15:16.987816+0000 mgr.y (mgr.14138) 487 : cluster [DBG] pgmap v350: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:19.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:19 smithi134 bash[9858]: cluster 2021-01-28T04:15:18.988828+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:19.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:19 smithi150 bash[9867]: cluster 2021-01-28T04:15:18.988828+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:19.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:19 smithi150 bash[13629]: cluster 2021-01-28T04:15:18.988828+0000 mgr.y (mgr.14138) 488 : cluster [DBG] pgmap v351: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:21.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:21 smithi134 bash[9858]: cluster 2021-01-28T04:15:20.989577+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:21.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:21 smithi134 bash[9858]: audit 2021-01-28T04:15:21.007080+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:15:21.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:21 smithi134 bash[9858]: audit 2021-01-28T04:15:21.007342+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:15:21.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:21 smithi150 bash[13629]: cluster 2021-01-28T04:15:20.989577+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:21.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:21 smithi150 bash[13629]: audit 2021-01-28T04:15:21.007080+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:15:21.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:21 smithi150 bash[13629]: audit 2021-01-28T04:15:21.007342+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:15:21.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:21 smithi150 bash[9867]: cluster 2021-01-28T04:15:20.989577+0000 mgr.y (mgr.14138) 489 : cluster [DBG] pgmap v352: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:21.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:21 smithi150 bash[9867]: audit 2021-01-28T04:15:21.007080+0000 mon.a (mon.0) 654 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:15:21.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:21 smithi150 bash[9867]: audit 2021-01-28T04:15:21.007342+0000 mon.a (mon.0) 655 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:15:21.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:15:21 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:15:21.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:15:21 smithi150 bash[10146]: debug 2021-01-28T04:15:21.577+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:15:22.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:22 smithi150 bash[9867]: audit 2021-01-28T04:15:21.580737+0000 mgr.y (mgr.14138) 490 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:22.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:22 smithi150 bash[13629]: audit 2021-01-28T04:15:21.580737+0000 mgr.y (mgr.14138) 490 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:23.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:22 smithi134 bash[9858]: audit 2021-01-28T04:15:21.580737+0000 mgr.y (mgr.14138) 490 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:23.670 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:23 smithi150 bash[9867]: cluster 2021-01-28T04:15:22.990746+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:23.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:23 smithi150 bash[13629]: cluster 2021-01-28T04:15:22.990746+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:24.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:23 smithi134 bash[9858]: cluster 2021-01-28T04:15:22.990746+0000 mgr.y (mgr.14138) 491 : cluster [DBG] pgmap v353: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:25.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:25 smithi134 bash[9858]: cluster 2021-01-28T04:15:24.991812+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:25.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:25 smithi150 bash[9867]: cluster 2021-01-28T04:15:24.991812+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:25.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:25 smithi150 bash[13629]: cluster 2021-01-28T04:15:24.991812+0000 mgr.y (mgr.14138) 492 : cluster [DBG] pgmap v354: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:27.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:27 smithi150 bash[9867]: cluster 2021-01-28T04:15:26.992710+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:27.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:27 smithi150 bash[13629]: cluster 2021-01-28T04:15:26.992710+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:28.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:27 smithi134 bash[9858]: cluster 2021-01-28T04:15:26.992710+0000 mgr.y (mgr.14138) 493 : cluster [DBG] pgmap v355: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:29.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:29 smithi134 bash[9858]: cluster 2021-01-28T04:15:28.994020+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:29.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:29 smithi150 bash[9867]: cluster 2021-01-28T04:15:28.994020+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:29.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:29 smithi150 bash[13629]: cluster 2021-01-28T04:15:28.994020+0000 mgr.y (mgr.14138) 494 : cluster [DBG] pgmap v356: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:31.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:31 smithi134 bash[9858]: cluster 2021-01-28T04:15:30.994863+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:31.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:31 smithi150 bash[13629]: cluster 2021-01-28T04:15:30.994863+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:31.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:31 smithi150 bash[9867]: cluster 2021-01-28T04:15:30.994863+0000 mgr.y (mgr.14138) 495 : cluster [DBG] pgmap v357: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:31.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:15:31 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:15:31.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:15:31 smithi150 bash[10146]: debug 2021-01-28T04:15:31.577+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:15:32.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:32 smithi150 bash[13629]: audit 2021-01-28T04:15:31.581985+0000 mgr.y (mgr.14138) 496 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:32.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:32 smithi150 bash[9867]: audit 2021-01-28T04:15:31.581985+0000 mgr.y (mgr.14138) 496 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:33.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:32 smithi134 bash[9858]: audit 2021-01-28T04:15:31.581985+0000 mgr.y (mgr.14138) 496 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:33.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:33 smithi150 bash[9867]: cluster 2021-01-28T04:15:32.995995+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:33.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:33 smithi150 bash[13629]: cluster 2021-01-28T04:15:32.995995+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:34.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:33 smithi134 bash[9858]: cluster 2021-01-28T04:15:32.995995+0000 mgr.y (mgr.14138) 497 : cluster [DBG] pgmap v358: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:35.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:35 smithi134 bash[9858]: cluster 2021-01-28T04:15:34.997076+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:35.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:35 smithi150 bash[9867]: cluster 2021-01-28T04:15:34.997076+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:35.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:35 smithi150 bash[13629]: cluster 2021-01-28T04:15:34.997076+0000 mgr.y (mgr.14138) 498 : cluster [DBG] pgmap v359: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:37.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:37 smithi150 bash[9867]: cluster 2021-01-28T04:15:36.997916+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:37.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:37 smithi150 bash[13629]: cluster 2021-01-28T04:15:36.997916+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:38.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:37 smithi134 bash[9858]: cluster 2021-01-28T04:15:36.997916+0000 mgr.y (mgr.14138) 499 : cluster [DBG] pgmap v360: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:39.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:39 smithi134 bash[9858]: cluster 2021-01-28T04:15:38.999305+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:39.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:39 smithi150 bash[13629]: cluster 2021-01-28T04:15:38.999305+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:39.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:39 smithi150 bash[9867]: cluster 2021-01-28T04:15:38.999305+0000 mgr.y (mgr.14138) 500 : cluster [DBG] pgmap v361: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:40.378 INFO:tasks.workunit.client.0.smithi150.stderr:Note: switching to '507028cb839c25d6666833702df6325fd8569096'. 2021-01-28T04:15:40.379 INFO:tasks.workunit.client.0.smithi150.stderr: 2021-01-28T04:15:40.379 INFO:tasks.workunit.client.0.smithi150.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2021-01-28T04:15:40.379 INFO:tasks.workunit.client.0.smithi150.stderr:changes and commit them, and you can discard any commits you make in this 2021-01-28T04:15:40.379 INFO:tasks.workunit.client.0.smithi150.stderr:state without impacting any branches by switching back to a branch. 2021-01-28T04:15:40.379 INFO:tasks.workunit.client.0.smithi150.stderr: 2021-01-28T04:15:40.380 INFO:tasks.workunit.client.0.smithi150.stderr:If you want to create a new branch to retain commits you create, you may 2021-01-28T04:15:40.380 INFO:tasks.workunit.client.0.smithi150.stderr:do so (now or later) by using -c with the switch command. Example: 2021-01-28T04:15:40.380 INFO:tasks.workunit.client.0.smithi150.stderr: 2021-01-28T04:15:40.380 INFO:tasks.workunit.client.0.smithi150.stderr: git switch -c 2021-01-28T04:15:40.380 INFO:tasks.workunit.client.0.smithi150.stderr: 2021-01-28T04:15:40.381 INFO:tasks.workunit.client.0.smithi150.stderr:Or undo this operation with: 2021-01-28T04:15:40.381 INFO:tasks.workunit.client.0.smithi150.stderr: 2021-01-28T04:15:40.381 INFO:tasks.workunit.client.0.smithi150.stderr: git switch - 2021-01-28T04:15:40.381 INFO:tasks.workunit.client.0.smithi150.stderr: 2021-01-28T04:15:40.381 INFO:tasks.workunit.client.0.smithi150.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2021-01-28T04:15:40.382 INFO:tasks.workunit.client.0.smithi150.stderr: 2021-01-28T04:15:40.382 INFO:tasks.workunit.client.0.smithi150.stderr:HEAD is now at 507028cb83 Merge branch 'wip-zabbix-ann' of https://github.com/tchaikov/ceph into wip-kefu-testing-2021-01-27-1353 2021-01-28T04:15:40.383 DEBUG:teuthology.orchestra.run.smithi150:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2021-01-28T04:15:40.415 INFO:tasks.workunit.client.0.smithi150.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2021-01-28T04:15:40.419 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-28T04:15:40.419 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2021-01-28T04:15:41.357 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2021-01-28T04:15:41.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:41 smithi134 bash[9858]: cluster 2021-01-28T04:15:41.000180+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v362: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:41.445 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2021-01-28T04:15:41.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:41 smithi150 bash[9867]: cluster 2021-01-28T04:15:41.000180+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v362: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:41.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:41 smithi150 bash[13629]: cluster 2021-01-28T04:15:41.000180+0000 mgr.y (mgr.14138) 501 : cluster [DBG] pgmap v362: 132 pgs: 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:41.500 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2021-01-28T04:15:41.503 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-28T04:15:41.503 INFO:tasks.workunit.client.0.smithi150.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2021-01-28T04:15:41.563 INFO:tasks.workunit.client.0.smithi150.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2021-01-28T04:15:41.568 DEBUG:teuthology.orchestra.run.smithi150:> set -ex 2021-01-28T04:15:41.568 DEBUG:teuthology.orchestra.run.smithi150:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2021-01-28T04:15:41.620 INFO:tasks.workunit:Running workunits matching rados/test_python.sh on client.0... 2021-01-28T04:15:41.621 INFO:tasks.workunit:Running workunit rados/test_python.sh... 2021-01-28T04:15:41.622 DEBUG:teuthology.orchestra.run.smithi150:workunit test rados/test_python.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=507028cb839c25d6666833702df6325fd8569096 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2021-01-28T04:15:41.634 INFO:tasks.workunit.client.0.smithi150.stderr:+ ceph osd pool create rbd 2021-01-28T04:15:41.888 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:15:41 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:15:41.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:15:41 smithi150 bash[10146]: debug 2021-01-28T04:15:41.589+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:15:42.789 INFO:tasks.workunit.client.0.smithi150.stderr:pool 'rbd' already exists 2021-01-28T04:15:42.798 INFO:tasks.workunit.client.0.smithi150.stderr:+ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test_python.sh 2021-01-28T04:15:42.799 INFO:tasks.workunit.client.0.smithi150.stderr:+ python3 -m nose -v /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/../../../src/test/pybind/test_rados.py 2021-01-28T04:15:42.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:42 smithi150 bash[13629]: audit 2021-01-28T04:15:41.593173+0000 mgr.y (mgr.14138) 502 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:42.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:42 smithi150 bash[13629]: audit 2021-01-28T04:15:41.907096+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.150:0/3303695498' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:42.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:42 smithi150 bash[13629]: audit 2021-01-28T04:15:41.907753+0000 mon.a (mon.0) 656 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:42.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:42 smithi150 bash[9867]: audit 2021-01-28T04:15:41.593173+0000 mgr.y (mgr.14138) 502 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:42.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:42 smithi150 bash[9867]: audit 2021-01-28T04:15:41.907096+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.150:0/3303695498' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:42.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:42 smithi150 bash[9867]: audit 2021-01-28T04:15:41.907753+0000 mon.a (mon.0) 656 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:43.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:42 smithi134 bash[9858]: audit 2021-01-28T04:15:41.593173+0000 mgr.y (mgr.14138) 502 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:43.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:42 smithi134 bash[9858]: audit 2021-01-28T04:15:41.907096+0000 mon.c (mon.1) 30 : audit [INF] from='client.? 172.21.15.150:0/3303695498' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:43.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:42 smithi134 bash[9858]: audit 2021-01-28T04:15:41.907753+0000 mon.a (mon.0) 656 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:43.754 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestCommand.test_ceph_osd_pool_create_utf8 ... ok 2021-01-28T04:15:43.794 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestCommand.test_monmap_dump ... ok 2021-01-28T04:15:43.810 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestCommand.test_osd_bench ... ok 2021-01-28T04:15:44.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:43 smithi134 bash[9858]: audit 2021-01-28T04:15:42.689550+0000 mon.a (mon.0) 657 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-28T04:15:44.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:43 smithi134 bash[9858]: cluster 2021-01-28T04:15:42.689710+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-28T04:15:44.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:43 smithi134 bash[9858]: audit 2021-01-28T04:15:42.785579+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.150:0/3303695498' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:44.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:43 smithi134 bash[9858]: audit 2021-01-28T04:15:42.786254+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:44.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:43 smithi134 bash[9858]: cluster 2021-01-28T04:15:43.001288+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v364: 164 pgs: 15 creating+peering, 17 unknown, 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:15:44.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:43 smithi134 bash[9858]: audit 2021-01-28T04:15:43.305210+0000 mon.a (mon.0) 660 : audit [INF] from='client.? 172.21.15.150:0/634360046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-28T04:15:44.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[13629]: audit 2021-01-28T04:15:42.689550+0000 mon.a (mon.0) 657 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-28T04:15:44.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[13629]: cluster 2021-01-28T04:15:42.689710+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-28T04:15:44.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[13629]: audit 2021-01-28T04:15:42.785579+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.150:0/3303695498' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:44.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[13629]: audit 2021-01-28T04:15:42.786254+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:44.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[13629]: cluster 2021-01-28T04:15:43.001288+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v364: 164 pgs: 15 creating+peering, 17 unknown, 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:15:44.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[13629]: audit 2021-01-28T04:15:43.305210+0000 mon.a (mon.0) 660 : audit [INF] from='client.? 172.21.15.150:0/634360046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-28T04:15:44.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[9867]: audit 2021-01-28T04:15:42.689550+0000 mon.a (mon.0) 657 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "rbd"}]': finished 2021-01-28T04:15:44.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[9867]: cluster 2021-01-28T04:15:42.689710+0000 mon.a (mon.0) 658 : cluster [DBG] osdmap e63: 8 total, 8 up, 8 in 2021-01-28T04:15:44.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[9867]: audit 2021-01-28T04:15:42.785579+0000 mon.c (mon.1) 31 : audit [INF] from='client.? 172.21.15.150:0/3303695498' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:44.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[9867]: audit 2021-01-28T04:15:42.786254+0000 mon.a (mon.0) 659 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "rbd"}]: dispatch 2021-01-28T04:15:44.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[9867]: cluster 2021-01-28T04:15:43.001288+0000 mgr.y (mgr.14138) 503 : cluster [DBG] pgmap v364: 164 pgs: 15 creating+peering, 17 unknown, 132 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:15:44.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:43 smithi150 bash[9867]: audit 2021-01-28T04:15:43.305210+0000 mon.a (mon.0) 660 : audit [INF] from='client.? 172.21.15.150:0/634360046' entity='client.admin' cmd=[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]: dispatch 2021-01-28T04:15:45.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:44 smithi134 bash[9858]: audit 2021-01-28T04:15:43.752416+0000 mon.a (mon.0) 661 : audit [INF] from='client.? 172.21.15.150:0/634360046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-28T04:15:45.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:44 smithi134 bash[9858]: cluster 2021-01-28T04:15:43.752650+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-28T04:15:45.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:44 smithi134 bash[9858]: audit 2021-01-28T04:15:43.791576+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-28T04:15:45.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:44 smithi134 bash[9858]: audit 2021-01-28T04:15:43.792170+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T04:15:45.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:44 smithi134 bash[9858]: audit 2021-01-28T04:15:43.792577+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-28T04:15:45.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:44 smithi134 bash[9858]: cluster 2021-01-28T04:15:44.753126+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-28T04:15:45.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[9867]: audit 2021-01-28T04:15:43.752416+0000 mon.a (mon.0) 661 : audit [INF] from='client.? 172.21.15.150:0/634360046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-28T04:15:45.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[9867]: cluster 2021-01-28T04:15:43.752650+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-28T04:15:45.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[9867]: audit 2021-01-28T04:15:43.791576+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-28T04:15:45.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[9867]: audit 2021-01-28T04:15:43.792170+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T04:15:45.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[9867]: audit 2021-01-28T04:15:43.792577+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-28T04:15:45.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[9867]: cluster 2021-01-28T04:15:44.753126+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-28T04:15:45.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[13629]: audit 2021-01-28T04:15:43.752416+0000 mon.a (mon.0) 661 : audit [INF] from='client.? 172.21.15.150:0/634360046' entity='client.admin' cmd='[{"prefix": "osd pool create", "pg_num": 16, "pool": "\u9ec5"}]': finished 2021-01-28T04:15:45.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[13629]: cluster 2021-01-28T04:15:43.752650+0000 mon.a (mon.0) 662 : cluster [DBG] osdmap e64: 8 total, 8 up, 8 in 2021-01-28T04:15:45.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[13629]: audit 2021-01-28T04:15:43.791576+0000 mon.c (mon.1) 32 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump"}]: dispatch 2021-01-28T04:15:45.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[13629]: audit 2021-01-28T04:15:43.792170+0000 mon.c (mon.1) 33 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2021-01-28T04:15:45.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[13629]: audit 2021-01-28T04:15:43.792577+0000 mon.c (mon.1) 34 : audit [DBG] from='client.? 172.21.15.150:0/2034043875' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json", "epoch": 1003}]: dispatch 2021-01-28T04:15:45.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:44 smithi150 bash[13629]: cluster 2021-01-28T04:15:44.753126+0000 mon.a (mon.0) 663 : cluster [DBG] osdmap e65: 8 total, 8 up, 8 in 2021-01-28T04:15:46.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:45 smithi134 bash[9858]: cluster 2021-01-28T04:15:45.002105+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v367: 212 pgs: 23 creating+peering, 49 unknown, 140 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:46.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:45 smithi134 bash[9858]: cluster 2021-01-28T04:15:45.756109+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-28T04:15:46.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:45 smithi150 bash[13629]: cluster 2021-01-28T04:15:45.002105+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v367: 212 pgs: 23 creating+peering, 49 unknown, 140 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:46.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:45 smithi150 bash[13629]: cluster 2021-01-28T04:15:45.756109+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-28T04:15:46.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:45 smithi150 bash[9867]: cluster 2021-01-28T04:15:45.002105+0000 mgr.y (mgr.14138) 504 : cluster [DBG] pgmap v367: 212 pgs: 23 creating+peering, 49 unknown, 140 active+clean; 25 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2021-01-28T04:15:46.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:45 smithi150 bash[9867]: cluster 2021-01-28T04:15:45.756109+0000 mon.a (mon.0) 664 : cluster [DBG] osdmap e66: 8 total, 8 up, 8 in 2021-01-28T04:15:48.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:47 smithi134 bash[9858]: cluster 2021-01-28T04:15:46.779199+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-28T04:15:48.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:47 smithi134 bash[9858]: cluster 2021-01-28T04:15:47.003110+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v370: 212 pgs: 23 creating+peering, 38 unknown, 151 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:48.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:47 smithi150 bash[9867]: cluster 2021-01-28T04:15:46.779199+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-28T04:15:48.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:47 smithi150 bash[9867]: cluster 2021-01-28T04:15:47.003110+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v370: 212 pgs: 23 creating+peering, 38 unknown, 151 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:48.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:47 smithi150 bash[13629]: cluster 2021-01-28T04:15:46.779199+0000 mon.a (mon.0) 665 : cluster [DBG] osdmap e67: 8 total, 8 up, 8 in 2021-01-28T04:15:48.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:47 smithi150 bash[13629]: cluster 2021-01-28T04:15:47.003110+0000 mgr.y (mgr.14138) 505 : cluster [DBG] pgmap v370: 212 pgs: 23 creating+peering, 38 unknown, 151 active+clean; 25 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:49.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:48 smithi134 bash[9858]: cluster 2021-01-28T04:15:47.782459+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-28T04:15:49.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:48 smithi150 bash[13629]: cluster 2021-01-28T04:15:47.782459+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-28T04:15:49.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:48 smithi150 bash[9867]: cluster 2021-01-28T04:15:47.782459+0000 mon.a (mon.0) 666 : cluster [DBG] osdmap e68: 8 total, 8 up, 8 in 2021-01-28T04:15:50.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:49 smithi134 bash[9858]: cluster 2021-01-28T04:15:48.801336+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-28T04:15:50.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:49 smithi134 bash[9858]: cluster 2021-01-28T04:15:49.004245+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v373: 212 pgs: 1 creating+peering, 2 unknown, 209 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-28T04:15:50.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:49 smithi150 bash[9867]: cluster 2021-01-28T04:15:48.801336+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-28T04:15:50.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:49 smithi150 bash[9867]: cluster 2021-01-28T04:15:49.004245+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v373: 212 pgs: 1 creating+peering, 2 unknown, 209 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-28T04:15:50.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:49 smithi150 bash[13629]: cluster 2021-01-28T04:15:48.801336+0000 mon.a (mon.0) 667 : cluster [DBG] osdmap e69: 8 total, 8 up, 8 in 2021-01-28T04:15:50.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:49 smithi150 bash[13629]: cluster 2021-01-28T04:15:49.004245+0000 mgr.y (mgr.14138) 506 : cluster [DBG] pgmap v373: 212 pgs: 1 creating+peering, 2 unknown, 209 active+clean; 25 KiB data, 56 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 767 B/s wr, 2 op/s 2021-01-28T04:15:51.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:50 smithi134 bash[9858]: cluster 2021-01-28T04:15:49.798125+0000 mon.a (mon.0) 668 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:15:51.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:50 smithi134 bash[9858]: cluster 2021-01-28T04:15:49.814296+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-28T04:15:51.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:50 smithi134 bash[9858]: audit 2021-01-28T04:15:49.816227+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.150:0/27919677' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:51.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:50 smithi150 bash[9867]: cluster 2021-01-28T04:15:49.798125+0000 mon.a (mon.0) 668 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:15:51.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:50 smithi150 bash[9867]: cluster 2021-01-28T04:15:49.814296+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-28T04:15:51.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:50 smithi150 bash[9867]: audit 2021-01-28T04:15:49.816227+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.150:0/27919677' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:51.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:50 smithi150 bash[13629]: cluster 2021-01-28T04:15:49.798125+0000 mon.a (mon.0) 668 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:15:51.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:50 smithi150 bash[13629]: cluster 2021-01-28T04:15:49.814296+0000 mon.a (mon.0) 669 : cluster [DBG] osdmap e70: 8 total, 8 up, 8 in 2021-01-28T04:15:51.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:50 smithi150 bash[13629]: audit 2021-01-28T04:15:49.816227+0000 mon.a (mon.0) 670 : audit [INF] from='client.? 172.21.15.150:0/27919677' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:51.831 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoCtxSelfManagedSnaps.test ... ok 2021-01-28T04:15:51.887 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:15:51 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:15:51.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:51 smithi134 bash[9858]: audit 2021-01-28T04:15:50.824212+0000 mon.a (mon.0) 671 : audit [INF] from='client.? 172.21.15.150:0/27919677' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:15:51.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:51 smithi134 bash[9858]: cluster 2021-01-28T04:15:50.824317+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-28T04:15:51.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:51 smithi134 bash[9858]: cluster 2021-01-28T04:15:51.005059+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v376: 212 pgs: 212 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 767 B/s wr, 1 op/s 2021-01-28T04:15:51.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:15:51 smithi150 bash[10146]: debug 2021-01-28T04:15:51.601+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:15:51.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:51 smithi150 bash[9867]: audit 2021-01-28T04:15:50.824212+0000 mon.a (mon.0) 671 : audit [INF] from='client.? 172.21.15.150:0/27919677' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:15:51.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:51 smithi150 bash[9867]: cluster 2021-01-28T04:15:50.824317+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-28T04:15:51.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:51 smithi150 bash[9867]: cluster 2021-01-28T04:15:51.005059+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v376: 212 pgs: 212 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 767 B/s wr, 1 op/s 2021-01-28T04:15:51.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:51 smithi150 bash[13629]: audit 2021-01-28T04:15:50.824212+0000 mon.a (mon.0) 671 : audit [INF] from='client.? 172.21.15.150:0/27919677' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:15:51.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:51 smithi150 bash[13629]: cluster 2021-01-28T04:15:50.824317+0000 mon.a (mon.0) 672 : cluster [DBG] osdmap e71: 8 total, 8 up, 8 in 2021-01-28T04:15:51.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:51 smithi150 bash[13629]: cluster 2021-01-28T04:15:51.005059+0000 mgr.y (mgr.14138) 507 : cluster [DBG] pgmap v376: 212 pgs: 212 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 767 B/s wr, 1 op/s 2021-01-28T04:15:53.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:52 smithi134 bash[9858]: audit 2021-01-28T04:15:51.604291+0000 mgr.y (mgr.14138) 508 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:53.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:52 smithi134 bash[9858]: cluster 2021-01-28T04:15:51.827925+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-28T04:15:53.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:52 smithi150 bash[13629]: audit 2021-01-28T04:15:51.604291+0000 mgr.y (mgr.14138) 508 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:53.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:52 smithi150 bash[13629]: cluster 2021-01-28T04:15:51.827925+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-28T04:15:53.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:52 smithi150 bash[9867]: audit 2021-01-28T04:15:51.604291+0000 mgr.y (mgr.14138) 508 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:15:53.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:52 smithi150 bash[9867]: cluster 2021-01-28T04:15:51.827925+0000 mon.a (mon.0) 673 : cluster [DBG] osdmap e72: 8 total, 8 up, 8 in 2021-01-28T04:15:54.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:53 smithi134 bash[9858]: cluster 2021-01-28T04:15:52.847711+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-28T04:15:54.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:53 smithi134 bash[9858]: cluster 2021-01-28T04:15:53.006354+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v379: 212 pgs: 16 creating+peering, 16 unknown, 180 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:54.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:53 smithi134 bash[9858]: cluster 2021-01-28T04:15:53.849971+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-28T04:15:54.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:53 smithi150 bash[9867]: cluster 2021-01-28T04:15:52.847711+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-28T04:15:54.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:53 smithi150 bash[9867]: cluster 2021-01-28T04:15:53.006354+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v379: 212 pgs: 16 creating+peering, 16 unknown, 180 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:54.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:53 smithi150 bash[9867]: cluster 2021-01-28T04:15:53.849971+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-28T04:15:54.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:53 smithi150 bash[13629]: cluster 2021-01-28T04:15:52.847711+0000 mon.a (mon.0) 674 : cluster [DBG] osdmap e73: 8 total, 8 up, 8 in 2021-01-28T04:15:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:53 smithi150 bash[13629]: cluster 2021-01-28T04:15:53.006354+0000 mgr.y (mgr.14138) 509 : cluster [DBG] pgmap v379: 212 pgs: 16 creating+peering, 16 unknown, 180 active+clean; 25 KiB data, 57 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:53 smithi150 bash[13629]: cluster 2021-01-28T04:15:53.849971+0000 mon.a (mon.0) 675 : cluster [DBG] osdmap e74: 8 total, 8 up, 8 in 2021-01-28T04:15:55.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:54 smithi134 bash[9858]: cluster 2021-01-28T04:15:53.859003+0000 mon.a (mon.0) 676 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:15:55.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:54 smithi134 bash[9858]: cluster 2021-01-28T04:15:53.859046+0000 mon.a (mon.0) 677 : cluster [INF] Cluster is now healthy 2021-01-28T04:15:55.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:54 smithi134 bash[9858]: audit 2021-01-28T04:15:53.911176+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.150:0/4172120932' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:55.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:54 smithi150 bash[9867]: cluster 2021-01-28T04:15:53.859003+0000 mon.a (mon.0) 676 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:15:55.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:54 smithi150 bash[9867]: cluster 2021-01-28T04:15:53.859046+0000 mon.a (mon.0) 677 : cluster [INF] Cluster is now healthy 2021-01-28T04:15:55.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:54 smithi150 bash[9867]: audit 2021-01-28T04:15:53.911176+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.150:0/4172120932' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:55.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:54 smithi150 bash[13629]: cluster 2021-01-28T04:15:53.859003+0000 mon.a (mon.0) 676 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:15:55.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:54 smithi150 bash[13629]: cluster 2021-01-28T04:15:53.859046+0000 mon.a (mon.0) 677 : cluster [INF] Cluster is now healthy 2021-01-28T04:15:55.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:54 smithi150 bash[13629]: audit 2021-01-28T04:15:53.911176+0000 mon.a (mon.0) 678 : audit [INF] from='client.? 172.21.15.150:0/4172120932' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:55.893 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_append ... ok 2021-01-28T04:15:56.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:55 smithi150 bash[13629]: audit 2021-01-28T04:15:54.879978+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.150:0/4172120932' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:15:56.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:55 smithi150 bash[13629]: cluster 2021-01-28T04:15:54.880092+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-28T04:15:56.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:55 smithi150 bash[13629]: cluster 2021-01-28T04:15:55.007132+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v382: 212 pgs: 20 creating+peering, 7 unknown, 185 active+clean; 25 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:56.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:55 smithi150 bash[9867]: audit 2021-01-28T04:15:54.879978+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.150:0/4172120932' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:15:56.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:55 smithi150 bash[9867]: cluster 2021-01-28T04:15:54.880092+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-28T04:15:56.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:55 smithi150 bash[9867]: cluster 2021-01-28T04:15:55.007132+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v382: 212 pgs: 20 creating+peering, 7 unknown, 185 active+clean; 25 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:56.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:55 smithi134 bash[9858]: audit 2021-01-28T04:15:54.879978+0000 mon.a (mon.0) 679 : audit [INF] from='client.? 172.21.15.150:0/4172120932' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:15:56.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:55 smithi134 bash[9858]: cluster 2021-01-28T04:15:54.880092+0000 mon.a (mon.0) 680 : cluster [DBG] osdmap e75: 8 total, 8 up, 8 in 2021-01-28T04:15:56.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:55 smithi134 bash[9858]: cluster 2021-01-28T04:15:55.007132+0000 mgr.y (mgr.14138) 510 : cluster [DBG] pgmap v382: 212 pgs: 20 creating+peering, 7 unknown, 185 active+clean; 25 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:15:57.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:56 smithi150 bash[9867]: cluster 2021-01-28T04:15:55.886016+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-28T04:15:57.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:56 smithi150 bash[13629]: cluster 2021-01-28T04:15:55.886016+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-28T04:15:57.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:56 smithi134 bash[9858]: cluster 2021-01-28T04:15:55.886016+0000 mon.a (mon.0) 681 : cluster [DBG] osdmap e76: 8 total, 8 up, 8 in 2021-01-28T04:15:58.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:57 smithi150 bash[9867]: cluster 2021-01-28T04:15:56.909046+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-28T04:15:58.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:57 smithi150 bash[9867]: cluster 2021-01-28T04:15:57.008130+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v385: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:58.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:57 smithi150 bash[13629]: cluster 2021-01-28T04:15:56.909046+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-28T04:15:58.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:57 smithi150 bash[13629]: cluster 2021-01-28T04:15:57.008130+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v385: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:58.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:57 smithi134 bash[9858]: cluster 2021-01-28T04:15:56.909046+0000 mon.a (mon.0) 682 : cluster [DBG] osdmap e77: 8 total, 8 up, 8 in 2021-01-28T04:15:58.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:57 smithi134 bash[9858]: cluster 2021-01-28T04:15:57.008130+0000 mgr.y (mgr.14138) 511 : cluster [DBG] pgmap v385: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 62 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:15:59.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:58 smithi150 bash[9867]: cluster 2021-01-28T04:15:57.918859+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-28T04:15:59.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:58 smithi150 bash[9867]: audit 2021-01-28T04:15:57.959456+0000 mon.a (mon.0) 684 : audit [INF] from='client.? 172.21.15.150:0/3467398552' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:59.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:58 smithi150 bash[13629]: cluster 2021-01-28T04:15:57.918859+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-28T04:15:59.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:58 smithi150 bash[13629]: audit 2021-01-28T04:15:57.959456+0000 mon.a (mon.0) 684 : audit [INF] from='client.? 172.21.15.150:0/3467398552' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:59.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:58 smithi134 bash[9858]: cluster 2021-01-28T04:15:57.918859+0000 mon.a (mon.0) 683 : cluster [DBG] osdmap e78: 8 total, 8 up, 8 in 2021-01-28T04:15:59.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:58 smithi134 bash[9858]: audit 2021-01-28T04:15:57.959456+0000 mon.a (mon.0) 684 : audit [INF] from='client.? 172.21.15.150:0/3467398552' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:15:59.933 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_cmpext ... ok 2021-01-28T04:16:00.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:59 smithi150 bash[13629]: audit 2021-01-28T04:15:58.921264+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.150:0/3467398552' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:00.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:59 smithi150 bash[13629]: cluster 2021-01-28T04:15:58.921381+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-28T04:16:00.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:15:59 smithi150 bash[13629]: cluster 2021-01-28T04:15:59.008972+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v388: 212 pgs: 8 creating+peering, 2 unknown, 202 active+clean; 25 KiB data, 63 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:16:00.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:59 smithi150 bash[9867]: audit 2021-01-28T04:15:58.921264+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.150:0/3467398552' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:00.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:59 smithi150 bash[9867]: cluster 2021-01-28T04:15:58.921381+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-28T04:16:00.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:15:59 smithi150 bash[9867]: cluster 2021-01-28T04:15:59.008972+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v388: 212 pgs: 8 creating+peering, 2 unknown, 202 active+clean; 25 KiB data, 63 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:16:00.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:59 smithi134 bash[9858]: audit 2021-01-28T04:15:58.921264+0000 mon.a (mon.0) 685 : audit [INF] from='client.? 172.21.15.150:0/3467398552' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:00.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:59 smithi134 bash[9858]: cluster 2021-01-28T04:15:58.921381+0000 mon.a (mon.0) 686 : cluster [DBG] osdmap e79: 8 total, 8 up, 8 in 2021-01-28T04:16:00.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:15:59 smithi134 bash[9858]: cluster 2021-01-28T04:15:59.008972+0000 mgr.y (mgr.14138) 512 : cluster [DBG] pgmap v388: 212 pgs: 8 creating+peering, 2 unknown, 202 active+clean; 25 KiB data, 63 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:16:01.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:00 smithi150 bash[9867]: cluster 2021-01-28T04:15:59.926288+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-28T04:16:01.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:00 smithi150 bash[9867]: cluster 2021-01-28T04:15:59.930776+0000 mon.a (mon.0) 688 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:01.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:00 smithi150 bash[13629]: cluster 2021-01-28T04:15:59.926288+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-28T04:16:01.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:00 smithi150 bash[13629]: cluster 2021-01-28T04:15:59.930776+0000 mon.a (mon.0) 688 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:01.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:00 smithi134 bash[9858]: cluster 2021-01-28T04:15:59.926288+0000 mon.a (mon.0) 687 : cluster [DBG] osdmap e80: 8 total, 8 up, 8 in 2021-01-28T04:16:01.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:00 smithi134 bash[9858]: cluster 2021-01-28T04:15:59.930776+0000 mon.a (mon.0) 688 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:01.887 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:16:01 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:16:01.973 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:16:01 smithi150 bash[10146]: debug 2021-01-28T04:16:01.608+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:16:02.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:01 smithi150 bash[9867]: cluster 2021-01-28T04:16:00.952740+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-28T04:16:02.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:01 smithi150 bash[9867]: cluster 2021-01-28T04:16:01.009775+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v391: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:02.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:01 smithi150 bash[13629]: cluster 2021-01-28T04:16:00.952740+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-28T04:16:02.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:01 smithi150 bash[13629]: cluster 2021-01-28T04:16:01.009775+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v391: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:02.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:01 smithi134 bash[9858]: cluster 2021-01-28T04:16:00.952740+0000 mon.a (mon.0) 689 : cluster [DBG] osdmap e81: 8 total, 8 up, 8 in 2021-01-28T04:16:02.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:01 smithi134 bash[9858]: cluster 2021-01-28T04:16:01.009775+0000 mgr.y (mgr.14138) 513 : cluster [DBG] pgmap v391: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 68 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:03.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:02 smithi134 bash[9858]: audit 2021-01-28T04:16:01.612553+0000 mgr.y (mgr.14138) 514 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:02 smithi134 bash[9858]: cluster 2021-01-28T04:16:01.946642+0000 mon.a (mon.0) 690 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:02 smithi134 bash[9858]: cluster 2021-01-28T04:16:01.946727+0000 mon.a (mon.0) 691 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:02 smithi134 bash[9858]: cluster 2021-01-28T04:16:01.960310+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-28T04:16:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:02 smithi134 bash[9858]: audit 2021-01-28T04:16:02.018172+0000 mon.a (mon.0) 693 : audit [INF] from='client.? 172.21.15.150:0/1600480758' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:03.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[9867]: audit 2021-01-28T04:16:01.612553+0000 mgr.y (mgr.14138) 514 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:03.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[9867]: cluster 2021-01-28T04:16:01.946642+0000 mon.a (mon.0) 690 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:03.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[9867]: cluster 2021-01-28T04:16:01.946727+0000 mon.a (mon.0) 691 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:03.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[9867]: cluster 2021-01-28T04:16:01.960310+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-28T04:16:03.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[9867]: audit 2021-01-28T04:16:02.018172+0000 mon.a (mon.0) 693 : audit [INF] from='client.? 172.21.15.150:0/1600480758' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:03.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[13629]: audit 2021-01-28T04:16:01.612553+0000 mgr.y (mgr.14138) 514 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:03.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[13629]: cluster 2021-01-28T04:16:01.946642+0000 mon.a (mon.0) 690 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:03.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[13629]: cluster 2021-01-28T04:16:01.946727+0000 mon.a (mon.0) 691 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:03.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[13629]: cluster 2021-01-28T04:16:01.960310+0000 mon.a (mon.0) 692 : cluster [DBG] osdmap e82: 8 total, 8 up, 8 in 2021-01-28T04:16:03.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:02 smithi150 bash[13629]: audit 2021-01-28T04:16:02.018172+0000 mon.a (mon.0) 693 : audit [INF] from='client.? 172.21.15.150:0/1600480758' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:03.993 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_execute ... ok 2021-01-28T04:16:04.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:04 smithi134 bash[9858]: audit 2021-01-28T04:16:02.983488+0000 mon.a (mon.0) 694 : audit [INF] from='client.? 172.21.15.150:0/1600480758' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:04.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:04 smithi134 bash[9858]: cluster 2021-01-28T04:16:02.983647+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-28T04:16:04.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:04 smithi134 bash[9858]: cluster 2021-01-28T04:16:03.010677+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v394: 212 pgs: 4 creating+peering, 9 unknown, 199 active+clean; 25 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:16:04.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:04 smithi134 bash[9858]: cluster 2021-01-28T04:16:03.986802+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-28T04:16:04.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:04 smithi150 bash[9867]: audit 2021-01-28T04:16:02.983488+0000 mon.a (mon.0) 694 : audit [INF] from='client.? 172.21.15.150:0/1600480758' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:04.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:04 smithi150 bash[9867]: cluster 2021-01-28T04:16:02.983647+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-28T04:16:04.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:04 smithi150 bash[9867]: cluster 2021-01-28T04:16:03.010677+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v394: 212 pgs: 4 creating+peering, 9 unknown, 199 active+clean; 25 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:16:04.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:04 smithi150 bash[9867]: cluster 2021-01-28T04:16:03.986802+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-28T04:16:04.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:04 smithi150 bash[13629]: audit 2021-01-28T04:16:02.983488+0000 mon.a (mon.0) 694 : audit [INF] from='client.? 172.21.15.150:0/1600480758' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:04.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:04 smithi150 bash[13629]: cluster 2021-01-28T04:16:02.983647+0000 mon.a (mon.0) 695 : cluster [DBG] osdmap e83: 8 total, 8 up, 8 in 2021-01-28T04:16:04.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:04 smithi150 bash[13629]: cluster 2021-01-28T04:16:03.010677+0000 mgr.y (mgr.14138) 515 : cluster [DBG] pgmap v394: 212 pgs: 4 creating+peering, 9 unknown, 199 active+clean; 25 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:16:04.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:04 smithi150 bash[13629]: cluster 2021-01-28T04:16:03.986802+0000 mon.a (mon.0) 696 : cluster [DBG] osdmap e84: 8 total, 8 up, 8 in 2021-01-28T04:16:06.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:06 smithi134 bash[9858]: cluster 2021-01-28T04:16:05.011965+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v397: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 85 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:06.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:06 smithi134 bash[9858]: cluster 2021-01-28T04:16:05.013775+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-28T04:16:06.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:06 smithi150 bash[9867]: cluster 2021-01-28T04:16:05.011965+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v397: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 85 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:06.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:06 smithi150 bash[9867]: cluster 2021-01-28T04:16:05.013775+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-28T04:16:06.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:06 smithi150 bash[13629]: cluster 2021-01-28T04:16:05.011965+0000 mgr.y (mgr.14138) 516 : cluster [DBG] pgmap v397: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 85 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:06.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:06 smithi150 bash[13629]: cluster 2021-01-28T04:16:05.013775+0000 mon.a (mon.0) 697 : cluster [DBG] osdmap e85: 8 total, 8 up, 8 in 2021-01-28T04:16:07.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:07 smithi134 bash[9858]: cluster 2021-01-28T04:16:06.019038+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-28T04:16:07.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:07 smithi134 bash[9858]: audit 2021-01-28T04:16:06.056983+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-28T04:16:07.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:07 smithi134 bash[9858]: audit 2021-01-28T04:16:06.057441+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:07.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:07 smithi134 bash[9858]: audit 2021-01-28T04:16:06.057732+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:07.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[13629]: cluster 2021-01-28T04:16:06.019038+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-28T04:16:07.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[13629]: audit 2021-01-28T04:16:06.056983+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-28T04:16:07.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[13629]: audit 2021-01-28T04:16:06.057441+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:07.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[13629]: audit 2021-01-28T04:16:06.057732+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:07.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[9867]: cluster 2021-01-28T04:16:06.019038+0000 mon.a (mon.0) 698 : cluster [DBG] osdmap e86: 8 total, 8 up, 8 in 2021-01-28T04:16:07.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[9867]: audit 2021-01-28T04:16:06.056983+0000 mon.c (mon.1) 35 : audit [DBG] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-28T04:16:07.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[9867]: audit 2021-01-28T04:16:06.057441+0000 mon.c (mon.1) 36 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:07.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[9867]: audit 2021-01-28T04:16:06.057732+0000 mon.a (mon.0) 699 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:07.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:07 smithi150 bash[9867]: debug 2021-01-28T04:16:07.032+0000 7f9c2bbec700 -1 mon.a@0(leader).osd e87 definitely_dead 0 2021-01-28T04:16:08.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:08 smithi134 bash[9858]: cluster 2021-01-28T04:16:07.013081+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v399: 212 pgs: 28 unknown, 184 active+clean; 25 KiB data, 86 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:08.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:08 smithi134 bash[9858]: cluster 2021-01-28T04:16:07.016609+0000 mon.a (mon.0) 700 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:08.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:08 smithi134 bash[9858]: audit 2021-01-28T04:16:07.033313+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:08.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:08 smithi134 bash[9858]: cluster 2021-01-28T04:16:07.033406+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-28T04:16:08.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:08 smithi134 bash[9858]: audit 2021-01-28T04:16:07.035179+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-28T04:16:08.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:08 smithi134 bash[9858]: audit 2021-01-28T04:16:07.036883+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-28T04:16:08.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[9867]: cluster 2021-01-28T04:16:07.013081+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v399: 212 pgs: 28 unknown, 184 active+clean; 25 KiB data, 86 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:08.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[9867]: cluster 2021-01-28T04:16:07.016609+0000 mon.a (mon.0) 700 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:08.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[9867]: audit 2021-01-28T04:16:07.033313+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:08.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[9867]: cluster 2021-01-28T04:16:07.033406+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-28T04:16:08.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[9867]: audit 2021-01-28T04:16:07.035179+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-28T04:16:08.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[9867]: audit 2021-01-28T04:16:07.036883+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-28T04:16:08.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[13629]: cluster 2021-01-28T04:16:07.013081+0000 mgr.y (mgr.14138) 517 : cluster [DBG] pgmap v399: 212 pgs: 28 unknown, 184 active+clean; 25 KiB data, 86 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:08.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[13629]: cluster 2021-01-28T04:16:07.016609+0000 mon.a (mon.0) 700 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:08.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[13629]: audit 2021-01-28T04:16:07.033313+0000 mon.a (mon.0) 701 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:08.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[13629]: cluster 2021-01-28T04:16:07.033406+0000 mon.a (mon.0) 702 : cluster [DBG] osdmap e87: 8 total, 8 up, 8 in 2021-01-28T04:16:08.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[13629]: audit 2021-01-28T04:16:07.035179+0000 mon.c (mon.1) 37 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-28T04:16:08.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:08 smithi150 bash[13629]: audit 2021-01-28T04:16:07.036883+0000 mon.a (mon.0) 703 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["4", "5", "3"]}]: dispatch 2021-01-28T04:16:09.378 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:09 smithi134 bash[9858]: cluster 2021-01-28T04:16:08.029532+0000 mon.a (mon.0) 704 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:09.378 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:09 smithi134 bash[9858]: audit 2021-01-28T04:16:08.035234+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-28T04:16:09.378 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:09 smithi134 bash[9858]: cluster 2021-01-28T04:16:08.035355+0000 mon.a (mon.0) 706 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-28T04:16:09.379 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:09 smithi134 bash[9858]: cluster 2021-01-28T04:16:08.918370+0000 mon.a (mon.0) 707 : cluster [INF] osd.4 marked itself dead as of e88 2021-01-28T04:16:09.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:09 smithi150 bash[9867]: cluster 2021-01-28T04:16:08.029532+0000 mon.a (mon.0) 704 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:09.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:09 smithi150 bash[9867]: audit 2021-01-28T04:16:08.035234+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-28T04:16:09.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:09 smithi150 bash[9867]: cluster 2021-01-28T04:16:08.035355+0000 mon.a (mon.0) 706 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-28T04:16:09.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:09 smithi150 bash[9867]: cluster 2021-01-28T04:16:08.918370+0000 mon.a (mon.0) 707 : cluster [INF] osd.4 marked itself dead as of e88 2021-01-28T04:16:09.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:09 smithi150 bash[13629]: cluster 2021-01-28T04:16:08.029532+0000 mon.a (mon.0) 704 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:09.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:09 smithi150 bash[13629]: audit 2021-01-28T04:16:08.035234+0000 mon.a (mon.0) 705 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["4", "5", "3"]}]': finished 2021-01-28T04:16:09.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:09 smithi150 bash[13629]: cluster 2021-01-28T04:16:08.035355+0000 mon.a (mon.0) 706 : cluster [DBG] osdmap e88: 8 total, 5 up, 8 in 2021-01-28T04:16:09.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:09 smithi150 bash[13629]: cluster 2021-01-28T04:16:08.918370+0000 mon.a (mon.0) 707 : cluster [INF] osd.4 marked itself dead as of e88 2021-01-28T04:16:09.637 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:16:09 smithi134 bash[12665]: debug 2021-01-28T04:16:09.373+0000 7f7cccbc4700 -1 osd.4 89 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:10.387 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:16:10 smithi134 bash[12665]: debug 2021-01-28T04:16:10.061+0000 7f7cbd119700 -1 osd.4 90 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:10.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:10 smithi134 bash[9858]: cluster 2021-01-28T04:16:08.918136+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-28T04:16:10.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:10 smithi134 bash[9858]: cluster 2021-01-28T04:16:08.918149+0000 osd.4 (osd.4) 4 : cluster [DBG] map e88 wrongly marked me down at e88 2021-01-28T04:16:10.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:10 smithi134 bash[9858]: cluster 2021-01-28T04:16:09.014521+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v402: 212 pgs: 24 peering, 37 stale+active+clean, 6 unknown, 145 active+clean; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:10.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:10 smithi134 bash[9858]: cluster 2021-01-28T04:16:09.032495+0000 mon.a (mon.0) 708 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:10.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:10 smithi134 bash[9858]: cluster 2021-01-28T04:16:09.038443+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-28T04:16:10.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:10 smithi134 bash[9858]: cluster 2021-01-28T04:16:09.501935+0000 mon.a (mon.0) 710 : cluster [INF] osd.5 marked itself dead as of e89 2021-01-28T04:16:10.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[9867]: cluster 2021-01-28T04:16:08.918136+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-28T04:16:10.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[9867]: cluster 2021-01-28T04:16:08.918149+0000 osd.4 (osd.4) 4 : cluster [DBG] map e88 wrongly marked me down at e88 2021-01-28T04:16:10.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[9867]: cluster 2021-01-28T04:16:09.014521+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v402: 212 pgs: 24 peering, 37 stale+active+clean, 6 unknown, 145 active+clean; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:10.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[9867]: cluster 2021-01-28T04:16:09.032495+0000 mon.a (mon.0) 708 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:10.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[9867]: cluster 2021-01-28T04:16:09.038443+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-28T04:16:10.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[9867]: cluster 2021-01-28T04:16:09.501935+0000 mon.a (mon.0) 710 : cluster [INF] osd.5 marked itself dead as of e89 2021-01-28T04:16:10.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[13629]: cluster 2021-01-28T04:16:08.918136+0000 osd.4 (osd.4) 3 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-28T04:16:10.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[13629]: cluster 2021-01-28T04:16:08.918149+0000 osd.4 (osd.4) 4 : cluster [DBG] map e88 wrongly marked me down at e88 2021-01-28T04:16:10.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[13629]: cluster 2021-01-28T04:16:09.014521+0000 mgr.y (mgr.14138) 518 : cluster [DBG] pgmap v402: 212 pgs: 24 peering, 37 stale+active+clean, 6 unknown, 145 active+clean; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:10.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[13629]: cluster 2021-01-28T04:16:09.032495+0000 mon.a (mon.0) 708 : cluster [WRN] Health check failed: Reduced data availability: 3 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:10.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[13629]: cluster 2021-01-28T04:16:09.038443+0000 mon.a (mon.0) 709 : cluster [DBG] osdmap e89: 8 total, 5 up, 8 in 2021-01-28T04:16:10.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[13629]: cluster 2021-01-28T04:16:09.501935+0000 mon.a (mon.0) 710 : cluster [INF] osd.5 marked itself dead as of e89 2021-01-28T04:16:10.887 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:16:10 smithi134 bash[15130]: debug 2021-01-28T04:16:10.405+0000 7fcdc8140700 -1 osd.5 90 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:10.975 INFO:journalctl@ceph.osd.3.smithi150.stdout:Jan 28 04:16:10 smithi150 bash[24235]: debug 2021-01-28T04:16:10.688+0000 7fe08b9bf700 -1 osd.3 90 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:11.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:11 smithi134 bash[9858]: cluster 2021-01-28T04:16:09.501939+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-28T04:16:11.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:11 smithi134 bash[9858]: cluster 2021-01-28T04:16:09.501949+0000 osd.5 (osd.5) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-28T04:16:11.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:11 smithi134 bash[9858]: cluster 2021-01-28T04:16:10.053901+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-28T04:16:11.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:11 smithi134 bash[9858]: cluster 2021-01-28T04:16:10.410493+0000 mon.a (mon.0) 712 : cluster [INF] osd.3 marked itself dead as of e90 2021-01-28T04:16:11.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:11 smithi134 bash[9858]: cluster 2021-01-28T04:16:11.015457+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v405: 212 pgs: 24 peering, 73 stale+active+clean, 6 unknown, 109 active+clean; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:11.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:11 smithi134 bash[9858]: audit 2021-01-28T04:16:11.043262+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:11.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:11 smithi134 bash[9858]: audit 2021-01-28T04:16:11.043945+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:11.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[9867]: cluster 2021-01-28T04:16:09.501939+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-28T04:16:11.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[9867]: cluster 2021-01-28T04:16:09.501949+0000 osd.5 (osd.5) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-28T04:16:11.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[9867]: cluster 2021-01-28T04:16:10.053901+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-28T04:16:11.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[9867]: cluster 2021-01-28T04:16:10.410493+0000 mon.a (mon.0) 712 : cluster [INF] osd.3 marked itself dead as of e90 2021-01-28T04:16:11.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[9867]: cluster 2021-01-28T04:16:11.015457+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v405: 212 pgs: 24 peering, 73 stale+active+clean, 6 unknown, 109 active+clean; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:11.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[9867]: audit 2021-01-28T04:16:11.043262+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:11.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[9867]: audit 2021-01-28T04:16:11.043945+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:11.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[13629]: cluster 2021-01-28T04:16:09.501939+0000 osd.5 (osd.5) 3 : cluster [WRN] Monitor daemon marked osd.5 down, but it is still running 2021-01-28T04:16:11.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[13629]: cluster 2021-01-28T04:16:09.501949+0000 osd.5 (osd.5) 4 : cluster [DBG] map e89 wrongly marked me down at e88 2021-01-28T04:16:11.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[13629]: cluster 2021-01-28T04:16:10.053901+0000 mon.a (mon.0) 711 : cluster [DBG] osdmap e90: 8 total, 5 up, 8 in 2021-01-28T04:16:11.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[13629]: cluster 2021-01-28T04:16:10.410493+0000 mon.a (mon.0) 712 : cluster [INF] osd.3 marked itself dead as of e90 2021-01-28T04:16:11.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[13629]: cluster 2021-01-28T04:16:11.015457+0000 mgr.y (mgr.14138) 519 : cluster [DBG] pgmap v405: 212 pgs: 24 peering, 73 stale+active+clean, 6 unknown, 109 active+clean; 25 KiB data, 87 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:11.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[13629]: audit 2021-01-28T04:16:11.043262+0000 mon.c (mon.1) 38 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:11.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[13629]: audit 2021-01-28T04:16:11.043945+0000 mon.a (mon.0) 713 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:11.887 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:16:11 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:16:11.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:16:11 smithi150 bash[10146]: debug 2021-01-28T04:16:11.620+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:16:12.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:12 smithi134 bash[9858]: cluster 2021-01-28T04:16:10.409542+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-28T04:16:12.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:12 smithi134 bash[9858]: cluster 2021-01-28T04:16:10.409560+0000 osd.3 (osd.3) 4 : cluster [DBG] map e90 wrongly marked me down at e88 2021-01-28T04:16:12.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:12 smithi134 bash[9858]: cluster 2021-01-28T04:16:11.049085+0000 mon.a (mon.0) 714 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:12.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:12 smithi134 bash[9858]: audit 2021-01-28T04:16:11.057215+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:12.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:12 smithi134 bash[9858]: cluster 2021-01-28T04:16:11.057415+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e91: 8 total, 5 up, 8 in 2021-01-28T04:16:12.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:12 smithi134 bash[9858]: audit 2021-01-28T04:16:11.623510+0000 mgr.y (mgr.14138) 520 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:12.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[13629]: cluster 2021-01-28T04:16:10.409542+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-28T04:16:12.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[13629]: cluster 2021-01-28T04:16:10.409560+0000 osd.3 (osd.3) 4 : cluster [DBG] map e90 wrongly marked me down at e88 2021-01-28T04:16:12.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[13629]: cluster 2021-01-28T04:16:11.049085+0000 mon.a (mon.0) 714 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:12.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[13629]: audit 2021-01-28T04:16:11.057215+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:12.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[13629]: cluster 2021-01-28T04:16:11.057415+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e91: 8 total, 5 up, 8 in 2021-01-28T04:16:12.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[13629]: audit 2021-01-28T04:16:11.623510+0000 mgr.y (mgr.14138) 520 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:12.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[9867]: cluster 2021-01-28T04:16:10.409542+0000 osd.3 (osd.3) 3 : cluster [WRN] Monitor daemon marked osd.3 down, but it is still running 2021-01-28T04:16:12.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[9867]: cluster 2021-01-28T04:16:10.409560+0000 osd.3 (osd.3) 4 : cluster [DBG] map e90 wrongly marked me down at e88 2021-01-28T04:16:12.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[9867]: cluster 2021-01-28T04:16:11.049085+0000 mon.a (mon.0) 714 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:12.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[9867]: audit 2021-01-28T04:16:11.057215+0000 mon.a (mon.0) 715 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:12.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[9867]: cluster 2021-01-28T04:16:11.057415+0000 mon.a (mon.0) 716 : cluster [DBG] osdmap e91: 8 total, 5 up, 8 in 2021-01-28T04:16:12.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:12 smithi150 bash[9867]: audit 2021-01-28T04:16:11.623510+0000 mgr.y (mgr.14138) 520 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:13.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: cluster 2021-01-28T04:16:12.067073+0000 mon.a (mon.0) 717 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:13.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: cluster 2021-01-28T04:16:12.080791+0000 mon.a (mon.0) 718 : cluster [INF] osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746] boot 2021-01-28T04:16:13.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: cluster 2021-01-28T04:16:12.082685+0000 mon.a (mon.0) 719 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:16:13.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: cluster 2021-01-28T04:16:12.082809+0000 mon.a (mon.0) 720 : cluster [INF] osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983] boot 2021-01-28T04:16:13.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: cluster 2021-01-28T04:16:12.082935+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-28T04:16:13.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: audit 2021-01-28T04:16:12.084218+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:16:13.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: audit 2021-01-28T04:16:12.084937+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:16:13.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: audit 2021-01-28T04:16:12.085350+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:16:13.390 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: cluster 2021-01-28T04:16:13.017122+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v408: 212 pgs: 34 active+clean, 8 undersized+peered, 17 active+undersized, 5 unknown, 41 stale+active+clean, 95 peering, 7 undersized+degraded+peered, 5 active+undersized+degraded; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 134/1071 objects degraded (12.512%); 11 B/s, 0 objects/s recovering 2021-01-28T04:16:13.390 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:13 smithi134 bash[9858]: cluster 2021-01-28T04:16:13.081183+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-28T04:16:13.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: cluster 2021-01-28T04:16:12.067073+0000 mon.a (mon.0) 717 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:13.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: cluster 2021-01-28T04:16:12.080791+0000 mon.a (mon.0) 718 : cluster [INF] osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746] boot 2021-01-28T04:16:13.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: cluster 2021-01-28T04:16:12.082685+0000 mon.a (mon.0) 719 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:16:13.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: cluster 2021-01-28T04:16:12.082809+0000 mon.a (mon.0) 720 : cluster [INF] osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983] boot 2021-01-28T04:16:13.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: cluster 2021-01-28T04:16:12.082935+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-28T04:16:13.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: audit 2021-01-28T04:16:12.084218+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:16:13.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: audit 2021-01-28T04:16:12.084937+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:16:13.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: audit 2021-01-28T04:16:12.085350+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:16:13.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: cluster 2021-01-28T04:16:13.017122+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v408: 212 pgs: 34 active+clean, 8 undersized+peered, 17 active+undersized, 5 unknown, 41 stale+active+clean, 95 peering, 7 undersized+degraded+peered, 5 active+undersized+degraded; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 134/1071 objects degraded (12.512%); 11 B/s, 0 objects/s recovering 2021-01-28T04:16:13.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[13629]: cluster 2021-01-28T04:16:13.081183+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-28T04:16:13.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: cluster 2021-01-28T04:16:12.067073+0000 mon.a (mon.0) 717 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:13.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: cluster 2021-01-28T04:16:12.080791+0000 mon.a (mon.0) 718 : cluster [INF] osd.3 [v2:172.21.15.150:6826/3623645746,v1:172.21.15.150:6827/3623645746] boot 2021-01-28T04:16:13.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: cluster 2021-01-28T04:16:12.082685+0000 mon.a (mon.0) 719 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:16:13.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: cluster 2021-01-28T04:16:12.082809+0000 mon.a (mon.0) 720 : cluster [INF] osd.5 [v2:172.21.15.134:6808/2513989983,v1:172.21.15.134:6809/2513989983] boot 2021-01-28T04:16:13.479 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: cluster 2021-01-28T04:16:12.082935+0000 mon.a (mon.0) 721 : cluster [DBG] osdmap e92: 8 total, 8 up, 8 in 2021-01-28T04:16:13.479 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: audit 2021-01-28T04:16:12.084218+0000 mon.a (mon.0) 722 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2021-01-28T04:16:13.479 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: audit 2021-01-28T04:16:12.084937+0000 mon.a (mon.0) 723 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:16:13.479 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: audit 2021-01-28T04:16:12.085350+0000 mon.a (mon.0) 724 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2021-01-28T04:16:13.479 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: cluster 2021-01-28T04:16:13.017122+0000 mgr.y (mgr.14138) 521 : cluster [DBG] pgmap v408: 212 pgs: 34 active+clean, 8 undersized+peered, 17 active+undersized, 5 unknown, 41 stale+active+clean, 95 peering, 7 undersized+degraded+peered, 5 active+undersized+degraded; 25 KiB data, 93 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s; 134/1071 objects degraded (12.512%); 11 B/s, 0 objects/s recovering 2021-01-28T04:16:13.480 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:13 smithi150 bash[9867]: cluster 2021-01-28T04:16:13.081183+0000 mon.a (mon.0) 725 : cluster [DBG] osdmap e93: 8 total, 8 up, 8 in 2021-01-28T04:16:14.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:14 smithi134 bash[9858]: cluster 2021-01-28T04:16:13.093828+0000 mon.a (mon.0) 726 : cluster [WRN] Health check failed: Degraded data redundancy: 134/1071 objects degraded (12.512%), 12 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:14.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:14 smithi134 bash[9858]: audit 2021-01-28T04:16:14.019040+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:14.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:14 smithi134 bash[9858]: audit 2021-01-28T04:16:14.019761+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:14.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:14 smithi150 bash[9867]: cluster 2021-01-28T04:16:13.093828+0000 mon.a (mon.0) 726 : cluster [WRN] Health check failed: Degraded data redundancy: 134/1071 objects degraded (12.512%), 12 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:14.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:14 smithi150 bash[9867]: audit 2021-01-28T04:16:14.019040+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:14.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:14 smithi150 bash[9867]: audit 2021-01-28T04:16:14.019761+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:14.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:14 smithi150 bash[13629]: cluster 2021-01-28T04:16:13.093828+0000 mon.a (mon.0) 726 : cluster [WRN] Health check failed: Degraded data redundancy: 134/1071 objects degraded (12.512%), 12 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:14.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:14 smithi150 bash[13629]: audit 2021-01-28T04:16:14.019040+0000 mon.c (mon.1) 39 : audit [INF] from='client.? 172.21.15.150:0/527555050' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:14.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:14 smithi150 bash[13629]: audit 2021-01-28T04:16:14.019761+0000 mon.a (mon.0) 727 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:15.138 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete ... ok 2021-01-28T04:16:15.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:15 smithi150 bash[9867]: audit 2021-01-28T04:16:14.121104+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:15.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:15 smithi150 bash[9867]: cluster 2021-01-28T04:16:14.121395+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-28T04:16:15.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:15 smithi150 bash[9867]: cluster 2021-01-28T04:16:15.018463+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v411: 212 pgs: 28 active+clean+wait, 84 active+clean, 4 undersized+peered, 13 active+undersized, 77 peering, 3 undersized+degraded+peered, 3 active+undersized+degraded; 25 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 63/1074 objects degraded (5.866%); 8 B/s, 0 objects/s recovering 2021-01-28T04:16:15.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:15 smithi150 bash[13629]: audit 2021-01-28T04:16:14.121104+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:15.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:15 smithi150 bash[13629]: cluster 2021-01-28T04:16:14.121395+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-28T04:16:15.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:15 smithi150 bash[13629]: cluster 2021-01-28T04:16:15.018463+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v411: 212 pgs: 28 active+clean+wait, 84 active+clean, 4 undersized+peered, 13 active+undersized, 77 peering, 3 undersized+degraded+peered, 3 active+undersized+degraded; 25 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 63/1074 objects degraded (5.866%); 8 B/s, 0 objects/s recovering 2021-01-28T04:16:15.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:15 smithi134 bash[9858]: audit 2021-01-28T04:16:14.121104+0000 mon.a (mon.0) 728 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:15.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:15 smithi134 bash[9858]: cluster 2021-01-28T04:16:14.121395+0000 mon.a (mon.0) 729 : cluster [DBG] osdmap e94: 8 total, 8 up, 8 in 2021-01-28T04:16:15.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:15 smithi134 bash[9858]: cluster 2021-01-28T04:16:15.018463+0000 mgr.y (mgr.14138) 522 : cluster [DBG] pgmap v411: 212 pgs: 28 active+clean+wait, 84 active+clean, 4 undersized+peered, 13 active+undersized, 77 peering, 3 undersized+degraded+peered, 3 active+undersized+degraded; 25 KiB data, 94 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s; 63/1074 objects degraded (5.866%); 8 B/s, 0 objects/s recovering 2021-01-28T04:16:16.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:16 smithi150 bash[9867]: cluster 2021-01-28T04:16:15.126574+0000 mon.a (mon.0) 730 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:16.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:16 smithi150 bash[9867]: cluster 2021-01-28T04:16:15.126698+0000 mon.a (mon.0) 731 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 1 pg peering) 2021-01-28T04:16:16.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:16 smithi150 bash[9867]: cluster 2021-01-28T04:16:15.133134+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-28T04:16:16.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:16 smithi150 bash[13629]: cluster 2021-01-28T04:16:15.126574+0000 mon.a (mon.0) 730 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:16.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:16 smithi150 bash[13629]: cluster 2021-01-28T04:16:15.126698+0000 mon.a (mon.0) 731 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 1 pg peering) 2021-01-28T04:16:16.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:16 smithi150 bash[13629]: cluster 2021-01-28T04:16:15.133134+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-28T04:16:16.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:16 smithi134 bash[9858]: cluster 2021-01-28T04:16:15.126574+0000 mon.a (mon.0) 730 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:16.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:16 smithi134 bash[9858]: cluster 2021-01-28T04:16:15.126698+0000 mon.a (mon.0) 731 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs inactive, 1 pg peering) 2021-01-28T04:16:16.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:16 smithi134 bash[9858]: cluster 2021-01-28T04:16:15.133134+0000 mon.a (mon.0) 732 : cluster [DBG] osdmap e95: 8 total, 8 up, 8 in 2021-01-28T04:16:17.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:17 smithi150 bash[9867]: cluster 2021-01-28T04:16:16.163719+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-28T04:16:17.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:17 smithi150 bash[9867]: cluster 2021-01-28T04:16:17.019814+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v414: 212 pgs: 4 creating+peering, 28 unknown, 24 active+clean+wait, 89 active+clean, 67 peering; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:17.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:17 smithi150 bash[13629]: cluster 2021-01-28T04:16:16.163719+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-28T04:16:17.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:17 smithi150 bash[13629]: cluster 2021-01-28T04:16:17.019814+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v414: 212 pgs: 4 creating+peering, 28 unknown, 24 active+clean+wait, 89 active+clean, 67 peering; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:17.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:17 smithi134 bash[9858]: cluster 2021-01-28T04:16:16.163719+0000 mon.a (mon.0) 733 : cluster [DBG] osdmap e96: 8 total, 8 up, 8 in 2021-01-28T04:16:17.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:17 smithi134 bash[9858]: cluster 2021-01-28T04:16:17.019814+0000 mgr.y (mgr.14138) 523 : cluster [DBG] pgmap v414: 212 pgs: 4 creating+peering, 28 unknown, 24 active+clean+wait, 89 active+clean, 67 peering; 25 KiB data, 95 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:18.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[13629]: cluster 2021-01-28T04:16:17.172009+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-28T04:16:18.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[13629]: audit 2021-01-28T04:16:17.210794+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-28T04:16:18.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[13629]: audit 2021-01-28T04:16:17.211245+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:18.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[13629]: cluster 2021-01-28T04:16:17.677719+0000 mon.a (mon.0) 737 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/1074 objects degraded (5.866%), 6 pgs degraded) 2021-01-28T04:16:18.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[13629]: cluster 2021-01-28T04:16:17.677785+0000 mon.a (mon.0) 738 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:18.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[13629]: cluster 2021-01-28T04:16:17.677808+0000 mon.a (mon.0) 739 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:18.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[9867]: debug 2021-01-28T04:16:18.192+0000 7f9c2bbec700 -1 mon.a@0(leader).osd e98 definitely_dead 0 2021-01-28T04:16:18.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[9867]: cluster 2021-01-28T04:16:17.172009+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-28T04:16:18.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[9867]: audit 2021-01-28T04:16:17.210794+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-28T04:16:18.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[9867]: audit 2021-01-28T04:16:17.211245+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:18.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[9867]: cluster 2021-01-28T04:16:17.677719+0000 mon.a (mon.0) 737 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/1074 objects degraded (5.866%), 6 pgs degraded) 2021-01-28T04:16:18.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[9867]: cluster 2021-01-28T04:16:17.677785+0000 mon.a (mon.0) 738 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:18.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:18 smithi150 bash[9867]: cluster 2021-01-28T04:16:17.677808+0000 mon.a (mon.0) 739 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:18.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:18 smithi134 bash[9858]: cluster 2021-01-28T04:16:17.172009+0000 mon.a (mon.0) 734 : cluster [DBG] osdmap e97: 8 total, 8 up, 8 in 2021-01-28T04:16:18.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:18 smithi134 bash[9858]: audit 2021-01-28T04:16:17.210794+0000 mon.a (mon.0) 735 : audit [DBG] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "foo", "format": "json"}]: dispatch 2021-01-28T04:16:18.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:18 smithi134 bash[9858]: audit 2021-01-28T04:16:17.211245+0000 mon.a (mon.0) 736 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:18.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:18 smithi134 bash[9858]: cluster 2021-01-28T04:16:17.677719+0000 mon.a (mon.0) 737 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 63/1074 objects degraded (5.866%), 6 pgs degraded) 2021-01-28T04:16:18.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:18 smithi134 bash[9858]: cluster 2021-01-28T04:16:17.677785+0000 mon.a (mon.0) 738 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:18.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:18 smithi134 bash[9858]: cluster 2021-01-28T04:16:17.677808+0000 mon.a (mon.0) 739 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:19.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[9867]: cluster 2021-01-28T04:16:18.178974+0000 mon.a (mon.0) 740 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:19.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[9867]: audit 2021-01-28T04:16:18.191903+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:19.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[9867]: cluster 2021-01-28T04:16:18.191990+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-28T04:16:19.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[9867]: audit 2021-01-28T04:16:18.197397+0000 mon.a (mon.0) 743 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-28T04:16:19.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.021110+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v417: 212 pgs: 4 creating+peering, 3 unknown, 34 active+clean+wait, 171 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:16:19.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.184453+0000 mon.a (mon.0) 744 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:19.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[9867]: audit 2021-01-28T04:16:19.194337+0000 mon.a (mon.0) 745 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-28T04:16:19.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.194669+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-28T04:16:19.479 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[13629]: cluster 2021-01-28T04:16:18.178974+0000 mon.a (mon.0) 740 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:19.479 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[13629]: audit 2021-01-28T04:16:18.191903+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:19.480 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[13629]: cluster 2021-01-28T04:16:18.191990+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-28T04:16:19.480 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[13629]: audit 2021-01-28T04:16:18.197397+0000 mon.a (mon.0) 743 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-28T04:16:19.481 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.021110+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v417: 212 pgs: 4 creating+peering, 3 unknown, 34 active+clean+wait, 171 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:16:19.481 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.184453+0000 mon.a (mon.0) 744 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:19.481 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[13629]: audit 2021-01-28T04:16:19.194337+0000 mon.a (mon.0) 745 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-28T04:16:19.482 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.194669+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-28T04:16:19.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:19 smithi134 bash[9858]: cluster 2021-01-28T04:16:18.178974+0000 mon.a (mon.0) 740 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:19.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:19 smithi134 bash[9858]: audit 2021-01-28T04:16:18.191903+0000 mon.a (mon.0) 741 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:19.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:19 smithi134 bash[9858]: cluster 2021-01-28T04:16:18.191990+0000 mon.a (mon.0) 742 : cluster [DBG] osdmap e98: 8 total, 8 up, 8 in 2021-01-28T04:16:19.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:19 smithi134 bash[9858]: audit 2021-01-28T04:16:18.197397+0000 mon.a (mon.0) 743 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["0", "2", "1"]}]: dispatch 2021-01-28T04:16:19.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:19 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.021110+0000 mgr.y (mgr.14138) 524 : cluster [DBG] pgmap v417: 212 pgs: 4 creating+peering, 3 unknown, 34 active+clean+wait, 171 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2021-01-28T04:16:19.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:19 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.184453+0000 mon.a (mon.0) 744 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:19.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:19 smithi134 bash[9858]: audit 2021-01-28T04:16:19.194337+0000 mon.a (mon.0) 745 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["0", "2", "1"]}]': finished 2021-01-28T04:16:19.640 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:19 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.194669+0000 mon.a (mon.0) 746 : cluster [DBG] osdmap e99: 8 total, 5 up, 8 in 2021-01-28T04:16:19.975 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:16:19 smithi150 bash[16733]: debug 2021-01-28T04:16:19.716+0000 7fd729670700 -1 osd.0 99 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:20.476 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[16733]: debug 2021-01-28T04:16:20.200+0000 7fd71bbc9700 -1 osd.0 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:20.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.199750+0000 mon.a (mon.0) 747 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:20.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.509369+0000 mon.a (mon.0) 748 : cluster [INF] osd.1 marked itself dead as of e99 2021-01-28T04:16:20.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.645951+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-28T04:16:20.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.645960+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-28T04:16:20.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.646760+0000 mon.a (mon.0) 749 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-28T04:16:20.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[9867]: cluster 2021-01-28T04:16:20.198684+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-28T04:16:20.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.199750+0000 mon.a (mon.0) 747 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:20.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.509369+0000 mon.a (mon.0) 748 : cluster [INF] osd.1 marked itself dead as of e99 2021-01-28T04:16:20.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.645951+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-28T04:16:20.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.645960+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-28T04:16:20.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.646760+0000 mon.a (mon.0) 749 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-28T04:16:20.479 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[13629]: cluster 2021-01-28T04:16:20.198684+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-28T04:16:20.479 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:16:20 smithi150 bash[19165]: debug 2021-01-28T04:16:20.236+0000 7f0a62406700 -1 osd.1 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:20.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:20 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.199750+0000 mon.a (mon.0) 747 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:16:20.665 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:20 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.509369+0000 mon.a (mon.0) 748 : cluster [INF] osd.1 marked itself dead as of e99 2021-01-28T04:16:20.665 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:20 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.645951+0000 osd.0 (osd.0) 3 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-28T04:16:20.666 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:20 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.645960+0000 osd.0 (osd.0) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-28T04:16:20.666 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:20 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.646760+0000 mon.a (mon.0) 749 : cluster [INF] osd.0 marked itself dead as of e99 2021-01-28T04:16:20.666 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:20 smithi134 bash[9858]: cluster 2021-01-28T04:16:20.198684+0000 mon.a (mon.0) 750 : cluster [DBG] osdmap e100: 8 total, 5 up, 8 in 2021-01-28T04:16:21.627 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[16733]: debug 2021-01-28T04:16:21.240+0000 7fd71bbc9700 -1 osd.0 101 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:21.627 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[21728]: debug 2021-01-28T04:16:21.224+0000 7fbb5de5b700 -1 osd.2 100 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:21.628 INFO:journalctl@ceph.osd.2.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[21728]: debug 2021-01-28T04:16:21.236+0000 7fbb4cbad700 -1 osd.2 101 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:21.628 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.508571+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-28T04:16:21.628 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[13629]: cluster 2021-01-28T04:16:19.508585+0000 osd.1 (osd.1) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-28T04:16:21.629 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[13629]: cluster 2021-01-28T04:16:20.418499+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-28T04:16:21.629 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[13629]: cluster 2021-01-28T04:16:20.418513+0000 osd.2 (osd.2) 4 : cluster [DBG] map e100 wrongly marked me down at e99 2021-01-28T04:16:21.630 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[13629]: cluster 2021-01-28T04:16:20.419666+0000 mon.a (mon.0) 751 : cluster [INF] osd.2 marked itself dead as of e100 2021-01-28T04:16:21.630 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[13629]: audit 2021-01-28T04:16:21.021260+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:16:21.630 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[13629]: audit 2021-01-28T04:16:21.021720+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:16:21.631 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[13629]: cluster 2021-01-28T04:16:21.021729+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v420: 212 pgs: 35 peering, 4 stale+creating+peering, 62 stale+active+clean, 27 active+clean+wait, 84 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-28T04:16:21.631 INFO:journalctl@ceph.osd.1.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[19165]: debug 2021-01-28T04:16:21.240+0000 7f0a51158700 -1 osd.1 101 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:21.632 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.508571+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-28T04:16:21.632 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[9867]: cluster 2021-01-28T04:16:19.508585+0000 osd.1 (osd.1) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-28T04:16:21.633 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[9867]: cluster 2021-01-28T04:16:20.418499+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-28T04:16:21.633 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[9867]: cluster 2021-01-28T04:16:20.418513+0000 osd.2 (osd.2) 4 : cluster [DBG] map e100 wrongly marked me down at e99 2021-01-28T04:16:21.633 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[9867]: cluster 2021-01-28T04:16:20.419666+0000 mon.a (mon.0) 751 : cluster [INF] osd.2 marked itself dead as of e100 2021-01-28T04:16:21.634 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[9867]: audit 2021-01-28T04:16:21.021260+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:16:21.634 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[9867]: audit 2021-01-28T04:16:21.021720+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:16:21.635 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[9867]: cluster 2021-01-28T04:16:21.021729+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v420: 212 pgs: 35 peering, 4 stale+creating+peering, 62 stale+active+clean, 27 active+clean+wait, 84 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-28T04:16:21.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.508571+0000 osd.1 (osd.1) 3 : cluster [WRN] Monitor daemon marked osd.1 down, but it is still running 2021-01-28T04:16:21.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[9858]: cluster 2021-01-28T04:16:19.508585+0000 osd.1 (osd.1) 4 : cluster [DBG] map e99 wrongly marked me down at e99 2021-01-28T04:16:21.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[9858]: cluster 2021-01-28T04:16:20.418499+0000 osd.2 (osd.2) 3 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-28T04:16:21.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[9858]: cluster 2021-01-28T04:16:20.418513+0000 osd.2 (osd.2) 4 : cluster [DBG] map e100 wrongly marked me down at e99 2021-01-28T04:16:21.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[9858]: cluster 2021-01-28T04:16:20.419666+0000 mon.a (mon.0) 751 : cluster [INF] osd.2 marked itself dead as of e100 2021-01-28T04:16:21.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[9858]: audit 2021-01-28T04:16:21.021260+0000 mon.a (mon.0) 752 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:16:21.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[9858]: audit 2021-01-28T04:16:21.021720+0000 mon.a (mon.0) 753 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:16:21.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[9858]: cluster 2021-01-28T04:16:21.021729+0000 mgr.y (mgr.14138) 525 : cluster [DBG] pgmap v420: 212 pgs: 35 peering, 4 stale+creating+peering, 62 stale+active+clean, 27 active+clean+wait, 84 active+clean; 25 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 255 B/s wr, 0 op/s 2021-01-28T04:16:21.887 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:16:21 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:16:21.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:16:21 smithi150 bash[10146]: debug 2021-01-28T04:16:21.624+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:16:22.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:22 smithi134 bash[9858]: cluster 2021-01-28T04:16:21.218646+0000 mon.a (mon.0) 754 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:22.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:22 smithi134 bash[9858]: cluster 2021-01-28T04:16:21.234974+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-28T04:16:22.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:22 smithi134 bash[9858]: audit 2021-01-28T04:16:21.626829+0000 mgr.y (mgr.14138) 526 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:22.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:22 smithi134 bash[9858]: audit 2021-01-28T04:16:22.203315+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:22.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:22 smithi150 bash[13629]: cluster 2021-01-28T04:16:21.218646+0000 mon.a (mon.0) 754 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:22.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:22 smithi150 bash[13629]: cluster 2021-01-28T04:16:21.234974+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-28T04:16:22.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:22 smithi150 bash[13629]: audit 2021-01-28T04:16:21.626829+0000 mgr.y (mgr.14138) 526 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:22.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:22 smithi150 bash[13629]: audit 2021-01-28T04:16:22.203315+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:22.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:22 smithi150 bash[9867]: cluster 2021-01-28T04:16:21.218646+0000 mon.a (mon.0) 754 : cluster [WRN] Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:22.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:22 smithi150 bash[9867]: cluster 2021-01-28T04:16:21.234974+0000 mon.a (mon.0) 755 : cluster [DBG] osdmap e101: 8 total, 5 up, 8 in 2021-01-28T04:16:22.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:22 smithi150 bash[9867]: audit 2021-01-28T04:16:21.626829+0000 mgr.y (mgr.14138) 526 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:22.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:22 smithi150 bash[9867]: audit 2021-01-28T04:16:22.203315+0000 mon.a (mon.0) 756 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:23.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:23 smithi134 bash[9858]: cluster 2021-01-28T04:16:22.680179+0000 mon.a (mon.0) 757 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:23.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:23 smithi134 bash[9858]: audit 2021-01-28T04:16:22.693027+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:23.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:23 smithi134 bash[9858]: cluster 2021-01-28T04:16:22.693688+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e102: 8 total, 5 up, 8 in 2021-01-28T04:16:23.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:23 smithi134 bash[9858]: cluster 2021-01-28T04:16:23.023202+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v423: 212 pgs: 14 undersized+peered, 31 active+undersized, 4 undersized+degraded+peered, 8 active+undersized+degraded, 35 peering, 2 stale+creating+peering, 36 stale+active+clean, 18 active+clean+wait, 64 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 94/1074 objects degraded (8.752%) 2021-01-28T04:16:23.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:23 smithi150 bash[13629]: cluster 2021-01-28T04:16:22.680179+0000 mon.a (mon.0) 757 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:23.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:23 smithi150 bash[13629]: audit 2021-01-28T04:16:22.693027+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:23.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:23 smithi150 bash[13629]: cluster 2021-01-28T04:16:22.693688+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e102: 8 total, 5 up, 8 in 2021-01-28T04:16:23.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:23 smithi150 bash[13629]: cluster 2021-01-28T04:16:23.023202+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v423: 212 pgs: 14 undersized+peered, 31 active+undersized, 4 undersized+degraded+peered, 8 active+undersized+degraded, 35 peering, 2 stale+creating+peering, 36 stale+active+clean, 18 active+clean+wait, 64 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 94/1074 objects degraded (8.752%) 2021-01-28T04:16:23.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:23 smithi150 bash[9867]: cluster 2021-01-28T04:16:22.680179+0000 mon.a (mon.0) 757 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:23.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:23 smithi150 bash[9867]: audit 2021-01-28T04:16:22.693027+0000 mon.a (mon.0) 758 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:23.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:23 smithi150 bash[9867]: cluster 2021-01-28T04:16:22.693688+0000 mon.a (mon.0) 759 : cluster [DBG] osdmap e102: 8 total, 5 up, 8 in 2021-01-28T04:16:23.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:23 smithi150 bash[9867]: cluster 2021-01-28T04:16:23.023202+0000 mgr.y (mgr.14138) 527 : cluster [DBG] pgmap v423: 212 pgs: 14 undersized+peered, 31 active+undersized, 4 undersized+degraded+peered, 8 active+undersized+degraded, 35 peering, 2 stale+creating+peering, 36 stale+active+clean, 18 active+clean+wait, 64 active+clean; 25 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 94/1074 objects degraded (8.752%) 2021-01-28T04:16:24.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: cluster 2021-01-28T04:16:23.683803+0000 mon.a (mon.0) 760 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:24.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: cluster 2021-01-28T04:16:23.684571+0000 mon.a (mon.0) 761 : cluster [WRN] Health check failed: Degraded data redundancy: 94/1074 objects degraded (8.752%), 12 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:24.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: cluster 2021-01-28T04:16:23.692393+0000 mon.a (mon.0) 762 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:16:24.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: cluster 2021-01-28T04:16:23.692479+0000 mon.a (mon.0) 763 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:16:24.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: cluster 2021-01-28T04:16:23.692591+0000 mon.a (mon.0) 764 : cluster [INF] osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724] boot 2021-01-28T04:16:24.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: cluster 2021-01-28T04:16:23.692647+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-28T04:16:24.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: audit 2021-01-28T04:16:23.697633+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:16:24.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: audit 2021-01-28T04:16:23.698473+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:16:24.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:24 smithi134 bash[9858]: audit 2021-01-28T04:16:23.699344+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:16:24.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: cluster 2021-01-28T04:16:23.683803+0000 mon.a (mon.0) 760 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:24.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: cluster 2021-01-28T04:16:23.684571+0000 mon.a (mon.0) 761 : cluster [WRN] Health check failed: Degraded data redundancy: 94/1074 objects degraded (8.752%), 12 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:24.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: cluster 2021-01-28T04:16:23.692393+0000 mon.a (mon.0) 762 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:16:24.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: cluster 2021-01-28T04:16:23.692479+0000 mon.a (mon.0) 763 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:16:24.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: cluster 2021-01-28T04:16:23.692591+0000 mon.a (mon.0) 764 : cluster [INF] osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724] boot 2021-01-28T04:16:24.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: cluster 2021-01-28T04:16:23.692647+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-28T04:16:24.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: audit 2021-01-28T04:16:23.697633+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:16:24.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: audit 2021-01-28T04:16:23.698473+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:16:24.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[9867]: audit 2021-01-28T04:16:23.699344+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:16:24.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: cluster 2021-01-28T04:16:23.683803+0000 mon.a (mon.0) 760 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:24.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: cluster 2021-01-28T04:16:23.684571+0000 mon.a (mon.0) 761 : cluster [WRN] Health check failed: Degraded data redundancy: 94/1074 objects degraded (8.752%), 12 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:24.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: cluster 2021-01-28T04:16:23.692393+0000 mon.a (mon.0) 762 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:16:24.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: cluster 2021-01-28T04:16:23.692479+0000 mon.a (mon.0) 763 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:16:24.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: cluster 2021-01-28T04:16:23.692591+0000 mon.a (mon.0) 764 : cluster [INF] osd.1 [v2:172.21.15.150:6810/2659937724,v1:172.21.15.150:6811/2659937724] boot 2021-01-28T04:16:24.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: cluster 2021-01-28T04:16:23.692647+0000 mon.a (mon.0) 765 : cluster [DBG] osdmap e103: 8 total, 8 up, 8 in 2021-01-28T04:16:24.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: audit 2021-01-28T04:16:23.697633+0000 mon.a (mon.0) 766 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:16:24.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: audit 2021-01-28T04:16:23.698473+0000 mon.a (mon.0) 767 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2021-01-28T04:16:24.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:24 smithi150 bash[13629]: audit 2021-01-28T04:16:23.699344+0000 mon.a (mon.0) 768 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:16:25.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:25 smithi150 bash[13629]: cluster 2021-01-28T04:16:24.694940+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-28T04:16:25.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:25 smithi150 bash[13629]: cluster 2021-01-28T04:16:25.024679+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v426: 212 pgs: 18 activating, 24 undersized+peered, 48 active+undersized, 4 undersized+degraded+peered, 11 active+undersized+degraded, 42 peering, 1 stale+creating+peering, 24 stale+active+clean, 4 active+clean+wait, 36 active+clean; 25 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 108/1074 objects degraded (10.056%) 2021-01-28T04:16:25.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:25 smithi150 bash[13629]: audit 2021-01-28T04:16:25.165612+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:25.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:25 smithi150 bash[9867]: cluster 2021-01-28T04:16:24.694940+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-28T04:16:25.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:25 smithi150 bash[9867]: cluster 2021-01-28T04:16:25.024679+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v426: 212 pgs: 18 activating, 24 undersized+peered, 48 active+undersized, 4 undersized+degraded+peered, 11 active+undersized+degraded, 42 peering, 1 stale+creating+peering, 24 stale+active+clean, 4 active+clean+wait, 36 active+clean; 25 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 108/1074 objects degraded (10.056%) 2021-01-28T04:16:25.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:25 smithi150 bash[9867]: audit 2021-01-28T04:16:25.165612+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:26.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:25 smithi134 bash[9858]: cluster 2021-01-28T04:16:24.694940+0000 mon.a (mon.0) 769 : cluster [DBG] osdmap e104: 8 total, 8 up, 8 in 2021-01-28T04:16:26.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:25 smithi134 bash[9858]: cluster 2021-01-28T04:16:25.024679+0000 mgr.y (mgr.14138) 528 : cluster [DBG] pgmap v426: 212 pgs: 18 activating, 24 undersized+peered, 48 active+undersized, 4 undersized+degraded+peered, 11 active+undersized+degraded, 42 peering, 1 stale+creating+peering, 24 stale+active+clean, 4 active+clean+wait, 36 active+clean; 25 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 108/1074 objects degraded (10.056%) 2021-01-28T04:16:26.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:25 smithi134 bash[9858]: audit 2021-01-28T04:16:25.165612+0000 mon.a (mon.0) 770 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:26.712 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete_and_cb ... ok 2021-01-28T04:16:26.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:26 smithi150 bash[9867]: audit 2021-01-28T04:16:25.702684+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:26.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:26 smithi150 bash[9867]: cluster 2021-01-28T04:16:25.702766+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-28T04:16:26.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:26 smithi150 bash[9867]: cluster 2021-01-28T04:16:26.677959+0000 mon.a (mon.0) 773 : cluster [WRN] Health check update: Reduced data availability: 5 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:26.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:26 smithi150 bash[13629]: audit 2021-01-28T04:16:25.702684+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:26.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:26 smithi150 bash[13629]: cluster 2021-01-28T04:16:25.702766+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-28T04:16:26.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:26 smithi150 bash[13629]: cluster 2021-01-28T04:16:26.677959+0000 mon.a (mon.0) 773 : cluster [WRN] Health check update: Reduced data availability: 5 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:27.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:26 smithi134 bash[9858]: audit 2021-01-28T04:16:25.702684+0000 mon.a (mon.0) 771 : audit [INF] from='client.? 172.21.15.150:0/3920146644' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:27.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:26 smithi134 bash[9858]: cluster 2021-01-28T04:16:25.702766+0000 mon.a (mon.0) 772 : cluster [DBG] osdmap e105: 8 total, 8 up, 8 in 2021-01-28T04:16:27.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:26 smithi134 bash[9858]: cluster 2021-01-28T04:16:26.677959+0000 mon.a (mon.0) 773 : cluster [WRN] Health check update: Reduced data availability: 5 pgs inactive, 2 pgs peering (PG_AVAILABILITY) 2021-01-28T04:16:28.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:27 smithi134 bash[9858]: cluster 2021-01-28T04:16:26.705233+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-28T04:16:28.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:27 smithi134 bash[9858]: cluster 2021-01-28T04:16:27.025881+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v429: 180 pgs: 16 activating, 16 undersized+peered, 33 active+undersized, 2 undersized+degraded+peered, 9 active+undersized+degraded, 32 peering, 12 stale+active+clean, 18 active+clean+wait, 42 active+clean; 25 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 71 op/s; 73/1071 objects degraded (6.816%) 2021-01-28T04:16:28.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:27 smithi150 bash[9867]: cluster 2021-01-28T04:16:26.705233+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-28T04:16:28.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:27 smithi150 bash[9867]: cluster 2021-01-28T04:16:27.025881+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v429: 180 pgs: 16 activating, 16 undersized+peered, 33 active+undersized, 2 undersized+degraded+peered, 9 active+undersized+degraded, 32 peering, 12 stale+active+clean, 18 active+clean+wait, 42 active+clean; 25 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 71 op/s; 73/1071 objects degraded (6.816%) 2021-01-28T04:16:28.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:27 smithi150 bash[13629]: cluster 2021-01-28T04:16:26.705233+0000 mon.a (mon.0) 774 : cluster [DBG] osdmap e106: 8 total, 8 up, 8 in 2021-01-28T04:16:28.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:27 smithi150 bash[13629]: cluster 2021-01-28T04:16:27.025881+0000 mgr.y (mgr.14138) 529 : cluster [DBG] pgmap v429: 180 pgs: 16 activating, 16 undersized+peered, 33 active+undersized, 2 undersized+degraded+peered, 9 active+undersized+degraded, 32 peering, 12 stale+active+clean, 18 active+clean+wait, 42 active+clean; 25 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 71 KiB/s rd, 71 op/s; 73/1071 objects degraded (6.816%) 2021-01-28T04:16:29.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:28 smithi134 bash[9858]: cluster 2021-01-28T04:16:27.711331+0000 mon.a (mon.0) 775 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:29.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:28 smithi134 bash[9858]: cluster 2021-01-28T04:16:27.736389+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-28T04:16:29.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:28 smithi134 bash[9858]: audit 2021-01-28T04:16:27.744162+0000 mon.a (mon.0) 777 : audit [DBG] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-28T04:16:29.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:28 smithi134 bash[9858]: audit 2021-01-28T04:16:27.745829+0000 mon.a (mon.0) 778 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:29.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[13629]: cluster 2021-01-28T04:16:27.711331+0000 mon.a (mon.0) 775 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:29.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[13629]: cluster 2021-01-28T04:16:27.736389+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-28T04:16:29.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[13629]: audit 2021-01-28T04:16:27.744162+0000 mon.a (mon.0) 777 : audit [DBG] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-28T04:16:29.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[13629]: audit 2021-01-28T04:16:27.745829+0000 mon.a (mon.0) 778 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:29.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[9867]: debug 2021-01-28T04:16:28.740+0000 7f9c2bbec700 -1 mon.a@0(leader).osd e108 definitely_dead 0 2021-01-28T04:16:29.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[9867]: cluster 2021-01-28T04:16:27.711331+0000 mon.a (mon.0) 775 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:16:29.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[9867]: cluster 2021-01-28T04:16:27.736389+0000 mon.a (mon.0) 776 : cluster [DBG] osdmap e107: 8 total, 8 up, 8 in 2021-01-28T04:16:29.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[9867]: audit 2021-01-28T04:16:27.744162+0000 mon.a (mon.0) 777 : audit [DBG] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd map", "pool": "test_pool", "object": "bar", "format": "json"}]: dispatch 2021-01-28T04:16:29.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:28 smithi150 bash[9867]: audit 2021-01-28T04:16:27.745829+0000 mon.a (mon.0) 778 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd set", "key": "noup"}]: dispatch 2021-01-28T04:16:30.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:29 smithi134 bash[9858]: cluster 2021-01-28T04:16:28.725716+0000 mon.a (mon.0) 779 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:30.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:29 smithi134 bash[9858]: audit 2021-01-28T04:16:28.737319+0000 mon.a (mon.0) 780 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:30.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:29 smithi134 bash[9858]: cluster 2021-01-28T04:16:28.737665+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-28T04:16:30.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:29 smithi134 bash[9858]: audit 2021-01-28T04:16:28.742930+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-28T04:16:30.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:29 smithi134 bash[9858]: cluster 2021-01-28T04:16:29.026999+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v432: 212 pgs: 12 creating+peering, 17 unknown, 16 activating, 34 active+clean+wait, 133 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 71 op/s; 160 B/s, 1 objects/s recovering 2021-01-28T04:16:30.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:29 smithi134 bash[9858]: cluster 2021-01-28T04:16:29.729542+0000 mon.a (mon.0) 783 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:30.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:29 smithi134 bash[9858]: audit 2021-01-28T04:16:29.738429+0000 mon.a (mon.0) 784 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-28T04:16:30.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:29 smithi134 bash[9858]: cluster 2021-01-28T04:16:29.738812+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-28T04:16:30.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[13629]: cluster 2021-01-28T04:16:28.725716+0000 mon.a (mon.0) 779 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:30.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[13629]: audit 2021-01-28T04:16:28.737319+0000 mon.a (mon.0) 780 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:30.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[13629]: cluster 2021-01-28T04:16:28.737665+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-28T04:16:30.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[13629]: audit 2021-01-28T04:16:28.742930+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-28T04:16:30.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[13629]: cluster 2021-01-28T04:16:29.026999+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v432: 212 pgs: 12 creating+peering, 17 unknown, 16 activating, 34 active+clean+wait, 133 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 71 op/s; 160 B/s, 1 objects/s recovering 2021-01-28T04:16:30.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[13629]: cluster 2021-01-28T04:16:29.729542+0000 mon.a (mon.0) 783 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:30.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[13629]: audit 2021-01-28T04:16:29.738429+0000 mon.a (mon.0) 784 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-28T04:16:30.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[13629]: cluster 2021-01-28T04:16:29.738812+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-28T04:16:30.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[9867]: cluster 2021-01-28T04:16:28.725716+0000 mon.a (mon.0) 779 : cluster [WRN] Health check failed: noup flag(s) set (OSDMAP_FLAGS) 2021-01-28T04:16:30.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[9867]: audit 2021-01-28T04:16:28.737319+0000 mon.a (mon.0) 780 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd set", "key": "noup"}]': finished 2021-01-28T04:16:30.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[9867]: cluster 2021-01-28T04:16:28.737665+0000 mon.a (mon.0) 781 : cluster [DBG] osdmap e108: 8 total, 8 up, 8 in 2021-01-28T04:16:30.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[9867]: audit 2021-01-28T04:16:28.742930+0000 mon.a (mon.0) 782 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd down", "ids": ["2", "0", "4"]}]: dispatch 2021-01-28T04:16:30.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[9867]: cluster 2021-01-28T04:16:29.026999+0000 mgr.y (mgr.14138) 530 : cluster [DBG] pgmap v432: 212 pgs: 12 creating+peering, 17 unknown, 16 activating, 34 active+clean+wait, 133 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 71 op/s; 160 B/s, 1 objects/s recovering 2021-01-28T04:16:30.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[9867]: cluster 2021-01-28T04:16:29.729542+0000 mon.a (mon.0) 783 : cluster [WRN] Health check failed: 3 osds down (OSD_DOWN) 2021-01-28T04:16:30.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[9867]: audit 2021-01-28T04:16:29.738429+0000 mon.a (mon.0) 784 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd down", "ids": ["2", "0", "4"]}]': finished 2021-01-28T04:16:30.229 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:29 smithi150 bash[9867]: cluster 2021-01-28T04:16:29.738812+0000 mon.a (mon.0) 785 : cluster [DBG] osdmap e109: 8 total, 5 up, 8 in 2021-01-28T04:16:31.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:30 smithi134 bash[9858]: cluster 2021-01-28T04:16:29.745996+0000 mon.a (mon.0) 786 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 1 pg peering) 2021-01-28T04:16:31.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:30 smithi134 bash[9858]: cluster 2021-01-28T04:16:29.746044+0000 mon.a (mon.0) 787 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 73/1071 objects degraded (6.816%), 11 pgs degraded) 2021-01-28T04:16:31.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:30 smithi150 bash[13629]: cluster 2021-01-28T04:16:29.745996+0000 mon.a (mon.0) 786 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 1 pg peering) 2021-01-28T04:16:31.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:30 smithi150 bash[13629]: cluster 2021-01-28T04:16:29.746044+0000 mon.a (mon.0) 787 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 73/1071 objects degraded (6.816%), 11 pgs degraded) 2021-01-28T04:16:31.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:30 smithi150 bash[9867]: cluster 2021-01-28T04:16:29.745996+0000 mon.a (mon.0) 786 : cluster [INF] Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs inactive, 1 pg peering) 2021-01-28T04:16:31.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:30 smithi150 bash[9867]: cluster 2021-01-28T04:16:29.746044+0000 mon.a (mon.0) 787 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 73/1071 objects degraded (6.816%), 11 pgs degraded) 2021-01-28T04:16:31.887 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:16:31.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[9858]: cluster 2021-01-28T04:16:30.742728+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-28T04:16:31.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[9858]: cluster 2021-01-28T04:16:30.772100+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-28T04:16:31.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[9858]: cluster 2021-01-28T04:16:30.772106+0000 osd.0 (osd.0) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-28T04:16:31.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[9858]: cluster 2021-01-28T04:16:30.773046+0000 mon.a (mon.0) 789 : cluster [INF] osd.0 marked itself dead as of e110 2021-01-28T04:16:31.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[9858]: cluster 2021-01-28T04:16:31.027843+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v435: 212 pgs: 2 stale+creating+peering, 20 stale+active+clean+wait, 49 stale+active+clean, 10 creating+peering, 12 unknown, 14 active+clean+wait, 105 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 160 B/s, 1 objects/s recovering 2021-01-28T04:16:31.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[9858]: cluster 2021-01-28T04:16:31.652451+0000 mon.a (mon.0) 790 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-28T04:16:31.890 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[9858]: cluster 2021-01-28T04:16:31.652769+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-28T04:16:31.890 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:31 smithi134 bash[9858]: cluster 2021-01-28T04:16:31.652778+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-28T04:16:31.975 INFO:journalctl@ceph.osd.0.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[16733]: debug 2021-01-28T04:16:31.816+0000 7fd727e6d700 -1 osd.0 111 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:31.976 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[10146]: debug 2021-01-28T04:16:31.624+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:16:31.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[13629]: cluster 2021-01-28T04:16:30.742728+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-28T04:16:31.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[13629]: cluster 2021-01-28T04:16:30.772100+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-28T04:16:31.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[13629]: cluster 2021-01-28T04:16:30.772106+0000 osd.0 (osd.0) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-28T04:16:31.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[13629]: cluster 2021-01-28T04:16:30.773046+0000 mon.a (mon.0) 789 : cluster [INF] osd.0 marked itself dead as of e110 2021-01-28T04:16:31.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[13629]: cluster 2021-01-28T04:16:31.027843+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v435: 212 pgs: 2 stale+creating+peering, 20 stale+active+clean+wait, 49 stale+active+clean, 10 creating+peering, 12 unknown, 14 active+clean+wait, 105 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 160 B/s, 1 objects/s recovering 2021-01-28T04:16:31.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[13629]: cluster 2021-01-28T04:16:31.652451+0000 mon.a (mon.0) 790 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-28T04:16:31.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[13629]: cluster 2021-01-28T04:16:31.652769+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-28T04:16:31.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[13629]: cluster 2021-01-28T04:16:31.652778+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-28T04:16:31.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[9867]: cluster 2021-01-28T04:16:30.742728+0000 mon.a (mon.0) 788 : cluster [DBG] osdmap e110: 8 total, 5 up, 8 in 2021-01-28T04:16:31.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[9867]: cluster 2021-01-28T04:16:30.772100+0000 osd.0 (osd.0) 5 : cluster [WRN] Monitor daemon marked osd.0 down, but it is still running 2021-01-28T04:16:31.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[9867]: cluster 2021-01-28T04:16:30.772106+0000 osd.0 (osd.0) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-28T04:16:31.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[9867]: cluster 2021-01-28T04:16:30.773046+0000 mon.a (mon.0) 789 : cluster [INF] osd.0 marked itself dead as of e110 2021-01-28T04:16:31.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[9867]: cluster 2021-01-28T04:16:31.027843+0000 mgr.y (mgr.14138) 531 : cluster [DBG] pgmap v435: 212 pgs: 2 stale+creating+peering, 20 stale+active+clean+wait, 49 stale+active+clean, 10 creating+peering, 12 unknown, 14 active+clean+wait, 105 active+clean; 25 KiB data, 103 MiB used, 715 GiB / 715 GiB avail; 160 B/s, 1 objects/s recovering 2021-01-28T04:16:31.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[9867]: cluster 2021-01-28T04:16:31.652451+0000 mon.a (mon.0) 790 : cluster [INF] osd.4 marked itself dead as of e110 2021-01-28T04:16:31.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[9867]: cluster 2021-01-28T04:16:31.652769+0000 osd.4 (osd.4) 5 : cluster [WRN] Monitor daemon marked osd.4 down, but it is still running 2021-01-28T04:16:31.979 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:31 smithi150 bash[9867]: cluster 2021-01-28T04:16:31.652778+0000 osd.4 (osd.4) 6 : cluster [DBG] map e110 wrongly marked me down at e109 2021-01-28T04:16:32.770 INFO:journalctl@ceph.osd.4.smithi134.stdout:Jan 28 04:16:32 smithi134 bash[12665]: debug 2021-01-28T04:16:32.428+0000 7f7ccb3c1700 -1 osd.4 111 osdmap NOUP flag is set, waiting for it to clear 2021-01-28T04:16:32.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:32 smithi134 bash[9858]: audit 2021-01-28T04:16:31.628136+0000 mgr.y (mgr.14138) 532 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:32.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:32 smithi134 bash[9858]: cluster 2021-01-28T04:16:31.774086+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-28T04:16:32.771 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:32 smithi134 bash[9858]: cluster 2021-01-28T04:16:32.744395+0000 mon.a (mon.0) 792 : cluster [INF] osd.2 marked itself dead as of e111 2021-01-28T04:16:32.772 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:32 smithi134 bash[9858]: audit 2021-01-28T04:16:32.747242+0000 mon.a (mon.0) 793 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:33.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:32 smithi150 bash[9867]: audit 2021-01-28T04:16:31.628136+0000 mgr.y (mgr.14138) 532 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:33.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:32 smithi150 bash[9867]: cluster 2021-01-28T04:16:31.774086+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-28T04:16:33.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:32 smithi150 bash[9867]: cluster 2021-01-28T04:16:32.744395+0000 mon.a (mon.0) 792 : cluster [INF] osd.2 marked itself dead as of e111 2021-01-28T04:16:33.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:32 smithi150 bash[9867]: audit 2021-01-28T04:16:32.747242+0000 mon.a (mon.0) 793 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:33.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:32 smithi150 bash[13629]: audit 2021-01-28T04:16:31.628136+0000 mgr.y (mgr.14138) 532 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:33.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:32 smithi150 bash[13629]: cluster 2021-01-28T04:16:31.774086+0000 mon.a (mon.0) 791 : cluster [DBG] osdmap e111: 8 total, 5 up, 8 in 2021-01-28T04:16:33.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:32 smithi150 bash[13629]: cluster 2021-01-28T04:16:32.744395+0000 mon.a (mon.0) 792 : cluster [INF] osd.2 marked itself dead as of e111 2021-01-28T04:16:33.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:32 smithi150 bash[13629]: audit 2021-01-28T04:16:32.747242+0000 mon.a (mon.0) 793 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:34.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:33 smithi134 bash[9858]: cluster 2021-01-28T04:16:32.743126+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-28T04:16:34.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:33 smithi134 bash[9858]: cluster 2021-01-28T04:16:32.743134+0000 osd.2 (osd.2) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-28T04:16:34.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:33 smithi134 bash[9858]: cluster 2021-01-28T04:16:32.768229+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:34.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:33 smithi134 bash[9858]: audit 2021-01-28T04:16:32.779304+0000 mon.a (mon.0) 795 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:34.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:33 smithi134 bash[9858]: cluster 2021-01-28T04:16:32.779526+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e112: 8 total, 5 up, 8 in 2021-01-28T04:16:34.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:33 smithi134 bash[9858]: cluster 2021-01-28T04:16:33.028751+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v438: 212 pgs: 3 undersized+peered+wait, 3 active+undersized+wait, 3 undersized+degraded+peered, 16 active+undersized+degraded, 13 undersized+peered, 45 active+undersized, 2 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 9 stale+active+clean+wait, 15 stale+active+clean, 3 creating+peering, 15 active+clean+wait, 82 active+clean; 25 KiB data, 109 MiB used, 715 GiB / 715 GiB avail; 224/1071 objects degraded (20.915%) 2021-01-28T04:16:34.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[9867]: cluster 2021-01-28T04:16:32.743126+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-28T04:16:34.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[9867]: cluster 2021-01-28T04:16:32.743134+0000 osd.2 (osd.2) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-28T04:16:34.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[9867]: cluster 2021-01-28T04:16:32.768229+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:34.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[9867]: audit 2021-01-28T04:16:32.779304+0000 mon.a (mon.0) 795 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:34.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[9867]: cluster 2021-01-28T04:16:32.779526+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e112: 8 total, 5 up, 8 in 2021-01-28T04:16:34.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[9867]: cluster 2021-01-28T04:16:33.028751+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v438: 212 pgs: 3 undersized+peered+wait, 3 active+undersized+wait, 3 undersized+degraded+peered, 16 active+undersized+degraded, 13 undersized+peered, 45 active+undersized, 2 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 9 stale+active+clean+wait, 15 stale+active+clean, 3 creating+peering, 15 active+clean+wait, 82 active+clean; 25 KiB data, 109 MiB used, 715 GiB / 715 GiB avail; 224/1071 objects degraded (20.915%) 2021-01-28T04:16:34.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[13629]: cluster 2021-01-28T04:16:32.743126+0000 osd.2 (osd.2) 5 : cluster [WRN] Monitor daemon marked osd.2 down, but it is still running 2021-01-28T04:16:34.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[13629]: cluster 2021-01-28T04:16:32.743134+0000 osd.2 (osd.2) 6 : cluster [DBG] map e111 wrongly marked me down at e109 2021-01-28T04:16:34.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[13629]: cluster 2021-01-28T04:16:32.768229+0000 mon.a (mon.0) 794 : cluster [INF] Health check cleared: OSDMAP_FLAGS (was: noup flag(s) set) 2021-01-28T04:16:34.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[13629]: audit 2021-01-28T04:16:32.779304+0000 mon.a (mon.0) 795 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:34.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[13629]: cluster 2021-01-28T04:16:32.779526+0000 mon.a (mon.0) 796 : cluster [DBG] osdmap e112: 8 total, 5 up, 8 in 2021-01-28T04:16:34.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:33 smithi150 bash[13629]: cluster 2021-01-28T04:16:33.028751+0000 mgr.y (mgr.14138) 533 : cluster [DBG] pgmap v438: 212 pgs: 3 undersized+peered+wait, 3 active+undersized+wait, 3 undersized+degraded+peered, 16 active+undersized+degraded, 13 undersized+peered, 45 active+undersized, 2 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 9 stale+active+clean+wait, 15 stale+active+clean, 3 creating+peering, 15 active+clean+wait, 82 active+clean; 25 KiB data, 109 MiB used, 715 GiB / 715 GiB avail; 224/1071 objects degraded (20.915%) 2021-01-28T04:16:35.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: cluster 2021-01-28T04:16:33.778414+0000 mon.a (mon.0) 797 : cluster [WRN] Health check failed: Degraded data redundancy: 224/1071 objects degraded (20.915%), 24 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:35.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: cluster 2021-01-28T04:16:33.780781+0000 mon.a (mon.0) 798 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:35.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: cluster 2021-01-28T04:16:33.780848+0000 mon.a (mon.0) 799 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:35.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: cluster 2021-01-28T04:16:33.790890+0000 mon.a (mon.0) 800 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:16:35.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: cluster 2021-01-28T04:16:33.791065+0000 mon.a (mon.0) 801 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:16:35.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: cluster 2021-01-28T04:16:33.791238+0000 mon.a (mon.0) 802 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:16:35.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: cluster 2021-01-28T04:16:33.791324+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-28T04:16:35.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: audit 2021-01-28T04:16:33.795873+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:16:35.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: audit 2021-01-28T04:16:33.796568+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:16:35.140 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:34 smithi134 bash[9858]: audit 2021-01-28T04:16:33.797364+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:16:35.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: cluster 2021-01-28T04:16:33.778414+0000 mon.a (mon.0) 797 : cluster [WRN] Health check failed: Degraded data redundancy: 224/1071 objects degraded (20.915%), 24 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:35.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: cluster 2021-01-28T04:16:33.780781+0000 mon.a (mon.0) 798 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:35.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: cluster 2021-01-28T04:16:33.780848+0000 mon.a (mon.0) 799 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:35.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: cluster 2021-01-28T04:16:33.790890+0000 mon.a (mon.0) 800 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:16:35.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: cluster 2021-01-28T04:16:33.791065+0000 mon.a (mon.0) 801 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:16:35.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: cluster 2021-01-28T04:16:33.791238+0000 mon.a (mon.0) 802 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:16:35.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: cluster 2021-01-28T04:16:33.791324+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-28T04:16:35.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: audit 2021-01-28T04:16:33.795873+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:16:35.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: audit 2021-01-28T04:16:33.796568+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:16:35.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[9867]: audit 2021-01-28T04:16:33.797364+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:16:35.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: cluster 2021-01-28T04:16:33.778414+0000 mon.a (mon.0) 797 : cluster [WRN] Health check failed: Degraded data redundancy: 224/1071 objects degraded (20.915%), 24 pgs degraded (PG_DEGRADED) 2021-01-28T04:16:35.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: cluster 2021-01-28T04:16:33.780781+0000 mon.a (mon.0) 798 : cluster [INF] Health check cleared: OSD_DOWN (was: 3 osds down) 2021-01-28T04:16:35.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: cluster 2021-01-28T04:16:33.780848+0000 mon.a (mon.0) 799 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:35.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: cluster 2021-01-28T04:16:33.790890+0000 mon.a (mon.0) 800 : cluster [INF] osd.4 [v2:172.21.15.134:6800/2281694848,v1:172.21.15.134:6801/2281694848] boot 2021-01-28T04:16:35.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: cluster 2021-01-28T04:16:33.791065+0000 mon.a (mon.0) 801 : cluster [INF] osd.0 [v2:172.21.15.150:6802/2923371016,v1:172.21.15.150:6803/2923371016] boot 2021-01-28T04:16:35.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: cluster 2021-01-28T04:16:33.791238+0000 mon.a (mon.0) 802 : cluster [INF] osd.2 [v2:172.21.15.150:6818/1301223535,v1:172.21.15.150:6819/1301223535] boot 2021-01-28T04:16:35.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: cluster 2021-01-28T04:16:33.791324+0000 mon.a (mon.0) 803 : cluster [DBG] osdmap e113: 8 total, 8 up, 8 in 2021-01-28T04:16:35.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: audit 2021-01-28T04:16:33.795873+0000 mon.a (mon.0) 804 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2021-01-28T04:16:35.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: audit 2021-01-28T04:16:33.796568+0000 mon.a (mon.0) 805 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2021-01-28T04:16:35.230 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:34 smithi150 bash[13629]: audit 2021-01-28T04:16:33.797364+0000 mon.a (mon.0) 806 : audit [DBG] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2021-01-28T04:16:36.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:35 smithi134 bash[9858]: cluster 2021-01-28T04:16:34.794780+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-28T04:16:36.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:35 smithi134 bash[9858]: cluster 2021-01-28T04:16:35.029882+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v441: 212 pgs: 47 peering, 2 undersized+peered+wait, 3 active+undersized+wait, 2 undersized+degraded+peered, 14 active+undersized+degraded, 21 undersized+peered, 56 active+undersized, 1 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 5 stale+active+clean+wait, 3 stale+active+clean, 12 active+clean+wait, 43 active+clean; 25 KiB data, 110 MiB used, 715 GiB / 715 GiB avail; 158/1071 objects degraded (14.753%) 2021-01-28T04:16:36.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:35 smithi150 bash[9867]: cluster 2021-01-28T04:16:34.794780+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-28T04:16:36.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:35 smithi150 bash[9867]: cluster 2021-01-28T04:16:35.029882+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v441: 212 pgs: 47 peering, 2 undersized+peered+wait, 3 active+undersized+wait, 2 undersized+degraded+peered, 14 active+undersized+degraded, 21 undersized+peered, 56 active+undersized, 1 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 5 stale+active+clean+wait, 3 stale+active+clean, 12 active+clean+wait, 43 active+clean; 25 KiB data, 110 MiB used, 715 GiB / 715 GiB avail; 158/1071 objects degraded (14.753%) 2021-01-28T04:16:36.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:35 smithi150 bash[13629]: cluster 2021-01-28T04:16:34.794780+0000 mon.a (mon.0) 807 : cluster [DBG] osdmap e114: 8 total, 8 up, 8 in 2021-01-28T04:16:36.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:35 smithi150 bash[13629]: cluster 2021-01-28T04:16:35.029882+0000 mgr.y (mgr.14138) 534 : cluster [DBG] pgmap v441: 212 pgs: 47 peering, 2 undersized+peered+wait, 3 active+undersized+wait, 2 undersized+degraded+peered, 14 active+undersized+degraded, 21 undersized+peered, 56 active+undersized, 1 undersized+degraded+peered+wait, 3 active+undersized+degraded+wait, 5 stale+active+clean+wait, 3 stale+active+clean, 12 active+clean+wait, 43 active+clean; 25 KiB data, 110 MiB used, 715 GiB / 715 GiB avail; 158/1071 objects degraded (14.753%) 2021-01-28T04:16:37.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:37 smithi150 bash[13629]: audit 2021-01-28T04:16:36.742695+0000 mon.a (mon.0) 808 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:37.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:37 smithi150 bash[9867]: audit 2021-01-28T04:16:36.742695+0000 mon.a (mon.0) 808 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:38.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:37 smithi134 bash[9858]: audit 2021-01-28T04:16:36.742695+0000 mon.a (mon.0) 808 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:38.714 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_read_wait_for_complete_and_cb_error ... ok 2021-01-28T04:16:38.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:38 smithi150 bash[13629]: cluster 2021-01-28T04:16:37.031205+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v442: 212 pgs: 47 peering, 2 undersized+degraded+peered, 11 active+undersized+degraded, 19 undersized+peered, 50 active+undersized, 1 undersized+degraded+peered+wait, 5 stale+active+clean+wait, 3 stale+active+clean, 3 active+clean+wait, 71 active+clean; 25 KiB data, 110 MiB used, 715 GiB / 715 GiB avail; 584 B/s rd, 0 op/s; 110/1071 objects degraded (10.271%) 2021-01-28T04:16:38.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:38 smithi150 bash[13629]: audit 2021-01-28T04:16:37.699242+0000 mon.a (mon.0) 809 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:38.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:38 smithi150 bash[13629]: cluster 2021-01-28T04:16:37.699351+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-28T04:16:38.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:38 smithi150 bash[9867]: cluster 2021-01-28T04:16:37.031205+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v442: 212 pgs: 47 peering, 2 undersized+degraded+peered, 11 active+undersized+degraded, 19 undersized+peered, 50 active+undersized, 1 undersized+degraded+peered+wait, 5 stale+active+clean+wait, 3 stale+active+clean, 3 active+clean+wait, 71 active+clean; 25 KiB data, 110 MiB used, 715 GiB / 715 GiB avail; 584 B/s rd, 0 op/s; 110/1071 objects degraded (10.271%) 2021-01-28T04:16:38.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:38 smithi150 bash[9867]: audit 2021-01-28T04:16:37.699242+0000 mon.a (mon.0) 809 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:38.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:38 smithi150 bash[9867]: cluster 2021-01-28T04:16:37.699351+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-28T04:16:39.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:38 smithi134 bash[9858]: cluster 2021-01-28T04:16:37.031205+0000 mgr.y (mgr.14138) 535 : cluster [DBG] pgmap v442: 212 pgs: 47 peering, 2 undersized+degraded+peered, 11 active+undersized+degraded, 19 undersized+peered, 50 active+undersized, 1 undersized+degraded+peered+wait, 5 stale+active+clean+wait, 3 stale+active+clean, 3 active+clean+wait, 71 active+clean; 25 KiB data, 110 MiB used, 715 GiB / 715 GiB avail; 584 B/s rd, 0 op/s; 110/1071 objects degraded (10.271%) 2021-01-28T04:16:39.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:38 smithi134 bash[9858]: audit 2021-01-28T04:16:37.699242+0000 mon.a (mon.0) 809 : audit [INF] from='client.? 172.21.15.150:0/201517389' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:39.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:38 smithi134 bash[9858]: cluster 2021-01-28T04:16:37.699351+0000 mon.a (mon.0) 810 : cluster [DBG] osdmap e115: 8 total, 8 up, 8 in 2021-01-28T04:16:39.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:39 smithi150 bash[13629]: cluster 2021-01-28T04:16:38.704770+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-28T04:16:39.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:39 smithi150 bash[9867]: cluster 2021-01-28T04:16:38.704770+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-28T04:16:40.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:39 smithi134 bash[9858]: cluster 2021-01-28T04:16:38.704770+0000 mon.a (mon.0) 811 : cluster [DBG] osdmap e116: 8 total, 8 up, 8 in 2021-01-28T04:16:40.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:40 smithi150 bash[9867]: cluster 2021-01-28T04:16:39.032146+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v445: 180 pgs: 23 peering, 15 active+clean+wait, 142 active+clean; 25 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 263 B/s, 3 objects/s recovering 2021-01-28T04:16:40.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:40 smithi150 bash[9867]: cluster 2021-01-28T04:16:39.713092+0000 mon.a (mon.0) 812 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 110/1071 objects degraded (10.271%), 14 pgs degraded) 2021-01-28T04:16:40.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:40 smithi150 bash[9867]: cluster 2021-01-28T04:16:39.713204+0000 mon.a (mon.0) 813 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:40.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:40 smithi150 bash[9867]: cluster 2021-01-28T04:16:39.731729+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-28T04:16:40.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:40 smithi150 bash[13629]: cluster 2021-01-28T04:16:39.032146+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v445: 180 pgs: 23 peering, 15 active+clean+wait, 142 active+clean; 25 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 263 B/s, 3 objects/s recovering 2021-01-28T04:16:40.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:40 smithi150 bash[13629]: cluster 2021-01-28T04:16:39.713092+0000 mon.a (mon.0) 812 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 110/1071 objects degraded (10.271%), 14 pgs degraded) 2021-01-28T04:16:40.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:40 smithi150 bash[13629]: cluster 2021-01-28T04:16:39.713204+0000 mon.a (mon.0) 813 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:40.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:40 smithi150 bash[13629]: cluster 2021-01-28T04:16:39.731729+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-28T04:16:41.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:40 smithi134 bash[9858]: cluster 2021-01-28T04:16:39.032146+0000 mgr.y (mgr.14138) 536 : cluster [DBG] pgmap v445: 180 pgs: 23 peering, 15 active+clean+wait, 142 active+clean; 25 KiB data, 120 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s; 263 B/s, 3 objects/s recovering 2021-01-28T04:16:41.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:40 smithi134 bash[9858]: cluster 2021-01-28T04:16:39.713092+0000 mon.a (mon.0) 812 : cluster [INF] Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 110/1071 objects degraded (10.271%), 14 pgs degraded) 2021-01-28T04:16:41.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:40 smithi134 bash[9858]: cluster 2021-01-28T04:16:39.713204+0000 mon.a (mon.0) 813 : cluster [INF] Cluster is now healthy 2021-01-28T04:16:41.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:40 smithi134 bash[9858]: cluster 2021-01-28T04:16:39.731729+0000 mon.a (mon.0) 814 : cluster [DBG] osdmap e117: 8 total, 8 up, 8 in 2021-01-28T04:16:41.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:16:41 smithi150 bash[10146]: debug 2021-01-28T04:16:41.635+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:16:41.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:41 smithi150 bash[9867]: cluster 2021-01-28T04:16:40.732713+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-28T04:16:41.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:41 smithi150 bash[9867]: audit 2021-01-28T04:16:40.799370+0000 mon.a (mon.0) 816 : audit [INF] from='client.? 172.21.15.150:0/1460142518' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:41.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:41 smithi150 bash[13629]: cluster 2021-01-28T04:16:40.732713+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-28T04:16:41.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:41 smithi150 bash[13629]: audit 2021-01-28T04:16:40.799370+0000 mon.a (mon.0) 816 : audit [INF] from='client.? 172.21.15.150:0/1460142518' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:42.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:16:41 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:16:42.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:41 smithi134 bash[9858]: cluster 2021-01-28T04:16:40.732713+0000 mon.a (mon.0) 815 : cluster [DBG] osdmap e118: 8 total, 8 up, 8 in 2021-01-28T04:16:42.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:41 smithi134 bash[9858]: audit 2021-01-28T04:16:40.799370+0000 mon.a (mon.0) 816 : audit [INF] from='client.? 172.21.15.150:0/1460142518' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:42.756 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_remove ... ok 2021-01-28T04:16:43.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:42 smithi134 bash[9858]: cluster 2021-01-28T04:16:41.032900+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v448: 212 pgs: 32 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:43.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:42 smithi134 bash[9858]: audit 2021-01-28T04:16:41.639379+0000 mgr.y (mgr.14138) 538 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:43.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:42 smithi134 bash[9858]: audit 2021-01-28T04:16:41.747471+0000 mon.a (mon.0) 817 : audit [INF] from='client.? 172.21.15.150:0/1460142518' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:43.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:42 smithi134 bash[9858]: cluster 2021-01-28T04:16:41.747563+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-28T04:16:43.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:42 smithi150 bash[9867]: cluster 2021-01-28T04:16:41.032900+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v448: 212 pgs: 32 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:43.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:42 smithi150 bash[9867]: audit 2021-01-28T04:16:41.639379+0000 mgr.y (mgr.14138) 538 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:43.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:42 smithi150 bash[9867]: audit 2021-01-28T04:16:41.747471+0000 mon.a (mon.0) 817 : audit [INF] from='client.? 172.21.15.150:0/1460142518' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:43.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:42 smithi150 bash[9867]: cluster 2021-01-28T04:16:41.747563+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-28T04:16:43.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:42 smithi150 bash[13629]: cluster 2021-01-28T04:16:41.032900+0000 mgr.y (mgr.14138) 537 : cluster [DBG] pgmap v448: 212 pgs: 32 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 121 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:43.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:42 smithi150 bash[13629]: audit 2021-01-28T04:16:41.639379+0000 mgr.y (mgr.14138) 538 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:43.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:42 smithi150 bash[13629]: audit 2021-01-28T04:16:41.747471+0000 mon.a (mon.0) 817 : audit [INF] from='client.? 172.21.15.150:0/1460142518' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:43.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:42 smithi150 bash[13629]: cluster 2021-01-28T04:16:41.747563+0000 mon.a (mon.0) 818 : cluster [DBG] osdmap e119: 8 total, 8 up, 8 in 2021-01-28T04:16:44.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:43 smithi134 bash[9858]: cluster 2021-01-28T04:16:42.750191+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-28T04:16:44.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:43 smithi150 bash[9867]: cluster 2021-01-28T04:16:42.750191+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-28T04:16:44.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:43 smithi150 bash[13629]: cluster 2021-01-28T04:16:42.750191+0000 mon.a (mon.0) 819 : cluster [DBG] osdmap e120: 8 total, 8 up, 8 in 2021-01-28T04:16:45.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:44 smithi134 bash[9858]: cluster 2021-01-28T04:16:43.034131+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v451: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-01-28T04:16:45.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:44 smithi134 bash[9858]: cluster 2021-01-28T04:16:43.774075+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-28T04:16:45.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:44 smithi150 bash[13629]: cluster 2021-01-28T04:16:43.034131+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v451: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-01-28T04:16:45.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:44 smithi150 bash[13629]: cluster 2021-01-28T04:16:43.774075+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-28T04:16:45.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:44 smithi150 bash[9867]: cluster 2021-01-28T04:16:43.034131+0000 mgr.y (mgr.14138) 539 : cluster [DBG] pgmap v451: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2021-01-28T04:16:45.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:44 smithi150 bash[9867]: cluster 2021-01-28T04:16:43.774075+0000 mon.a (mon.0) 820 : cluster [DBG] osdmap e121: 8 total, 8 up, 8 in 2021-01-28T04:16:46.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:45 smithi134 bash[9858]: cluster 2021-01-28T04:16:44.776380+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-28T04:16:46.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:45 smithi134 bash[9858]: audit 2021-01-28T04:16:44.812376+0000 mon.a (mon.0) 822 : audit [INF] from='client.? 172.21.15.150:0/2900335367' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:46.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:45 smithi150 bash[13629]: cluster 2021-01-28T04:16:44.776380+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-28T04:16:46.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:45 smithi150 bash[13629]: audit 2021-01-28T04:16:44.812376+0000 mon.a (mon.0) 822 : audit [INF] from='client.? 172.21.15.150:0/2900335367' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:46.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:45 smithi150 bash[9867]: cluster 2021-01-28T04:16:44.776380+0000 mon.a (mon.0) 821 : cluster [DBG] osdmap e122: 8 total, 8 up, 8 in 2021-01-28T04:16:46.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:45 smithi150 bash[9867]: audit 2021-01-28T04:16:44.812376+0000 mon.a (mon.0) 822 : audit [INF] from='client.? 172.21.15.150:0/2900335367' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:46.803 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_rmxattr ... ok 2021-01-28T04:16:47.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:46 smithi134 bash[9858]: cluster 2021-01-28T04:16:45.035026+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v454: 212 pgs: 9 creating+peering, 23 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:47.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:46 smithi134 bash[9858]: audit 2021-01-28T04:16:45.795521+0000 mon.a (mon.0) 823 : audit [INF] from='client.? 172.21.15.150:0/2900335367' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:47.139 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:46 smithi134 bash[9858]: cluster 2021-01-28T04:16:45.795675+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-28T04:16:47.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:46 smithi150 bash[9867]: cluster 2021-01-28T04:16:45.035026+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v454: 212 pgs: 9 creating+peering, 23 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:47.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:46 smithi150 bash[9867]: audit 2021-01-28T04:16:45.795521+0000 mon.a (mon.0) 823 : audit [INF] from='client.? 172.21.15.150:0/2900335367' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:47.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:46 smithi150 bash[9867]: cluster 2021-01-28T04:16:45.795675+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-28T04:16:47.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:46 smithi150 bash[13629]: cluster 2021-01-28T04:16:45.035026+0000 mgr.y (mgr.14138) 540 : cluster [DBG] pgmap v454: 212 pgs: 9 creating+peering, 23 unknown, 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:47.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:46 smithi150 bash[13629]: audit 2021-01-28T04:16:45.795521+0000 mon.a (mon.0) 823 : audit [INF] from='client.? 172.21.15.150:0/2900335367' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:47.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:46 smithi150 bash[13629]: cluster 2021-01-28T04:16:45.795675+0000 mon.a (mon.0) 824 : cluster [DBG] osdmap e123: 8 total, 8 up, 8 in 2021-01-28T04:16:48.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:47 smithi134 bash[9858]: cluster 2021-01-28T04:16:46.798514+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-28T04:16:48.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:47 smithi150 bash[9867]: cluster 2021-01-28T04:16:46.798514+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-28T04:16:48.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:47 smithi150 bash[13629]: cluster 2021-01-28T04:16:46.798514+0000 mon.a (mon.0) 825 : cluster [DBG] osdmap e124: 8 total, 8 up, 8 in 2021-01-28T04:16:49.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:48 smithi134 bash[9858]: cluster 2021-01-28T04:16:47.035923+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v457: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:49.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:48 smithi134 bash[9858]: cluster 2021-01-28T04:16:47.822552+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-28T04:16:49.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:48 smithi150 bash[13629]: cluster 2021-01-28T04:16:47.035923+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v457: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:49.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:48 smithi150 bash[13629]: cluster 2021-01-28T04:16:47.822552+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-28T04:16:49.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:48 smithi150 bash[9867]: cluster 2021-01-28T04:16:47.035923+0000 mgr.y (mgr.14138) 541 : cluster [DBG] pgmap v457: 180 pgs: 28 active+clean+wait, 152 active+clean; 25 KiB data, 122 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:49.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:48 smithi150 bash[9867]: cluster 2021-01-28T04:16:47.822552+0000 mon.a (mon.0) 826 : cluster [DBG] osdmap e125: 8 total, 8 up, 8 in 2021-01-28T04:16:50.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:49 smithi134 bash[9858]: cluster 2021-01-28T04:16:48.822395+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-28T04:16:50.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:49 smithi134 bash[9858]: audit 2021-01-28T04:16:48.856252+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.150:0/612526359' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:50.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:49 smithi134 bash[9858]: audit 2021-01-28T04:16:48.856673+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:50.225 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:49 smithi150 bash[13629]: cluster 2021-01-28T04:16:48.822395+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-28T04:16:50.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:49 smithi150 bash[13629]: audit 2021-01-28T04:16:48.856252+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.150:0/612526359' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:50.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:49 smithi150 bash[13629]: audit 2021-01-28T04:16:48.856673+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:50.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:49 smithi150 bash[9867]: cluster 2021-01-28T04:16:48.822395+0000 mon.a (mon.0) 827 : cluster [DBG] osdmap e126: 8 total, 8 up, 8 in 2021-01-28T04:16:50.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:49 smithi150 bash[9867]: audit 2021-01-28T04:16:48.856252+0000 mon.c (mon.1) 40 : audit [INF] from='client.? 172.21.15.150:0/612526359' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:50.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:49 smithi150 bash[9867]: audit 2021-01-28T04:16:48.856673+0000 mon.a (mon.0) 828 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:50.858 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_setxattr ... ok 2021-01-28T04:16:51.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:50 smithi134 bash[9858]: cluster 2021-01-28T04:16:49.036993+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v460: 212 pgs: 4 creating+activating, 17 creating+peering, 10 unknown, 13 active+clean+wait, 168 active+clean; 25 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:51.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:50 smithi134 bash[9858]: audit 2021-01-28T04:16:49.846747+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:51.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:50 smithi134 bash[9858]: cluster 2021-01-28T04:16:49.846955+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-28T04:16:51.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:50 smithi150 bash[9867]: cluster 2021-01-28T04:16:49.036993+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v460: 212 pgs: 4 creating+activating, 17 creating+peering, 10 unknown, 13 active+clean+wait, 168 active+clean; 25 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:51.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:50 smithi150 bash[9867]: audit 2021-01-28T04:16:49.846747+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:51.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:50 smithi150 bash[9867]: cluster 2021-01-28T04:16:49.846955+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-28T04:16:51.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:50 smithi150 bash[13629]: cluster 2021-01-28T04:16:49.036993+0000 mgr.y (mgr.14138) 542 : cluster [DBG] pgmap v460: 212 pgs: 4 creating+activating, 17 creating+peering, 10 unknown, 13 active+clean+wait, 168 active+clean; 25 KiB data, 132 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:51.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:50 smithi150 bash[13629]: audit 2021-01-28T04:16:49.846747+0000 mon.a (mon.0) 829 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:51.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:50 smithi150 bash[13629]: cluster 2021-01-28T04:16:49.846955+0000 mon.a (mon.0) 830 : cluster [DBG] osdmap e127: 8 total, 8 up, 8 in 2021-01-28T04:16:51.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:51 smithi150 bash[9867]: cluster 2021-01-28T04:16:50.849583+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-28T04:16:51.976 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:16:51 smithi150 bash[10146]: debug 2021-01-28T04:16:51.647+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:16:51.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:51 smithi150 bash[13629]: cluster 2021-01-28T04:16:50.849583+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-28T04:16:52.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:51 smithi134 bash[9858]: cluster 2021-01-28T04:16:50.849583+0000 mon.a (mon.0) 831 : cluster [DBG] osdmap e128: 8 total, 8 up, 8 in 2021-01-28T04:16:52.138 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:16:51 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:16:53.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:52 smithi134 bash[9858]: cluster 2021-01-28T04:16:51.037689+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v463: 180 pgs: 180 active+clean; 25 KiB data, 136 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:53.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:52 smithi134 bash[9858]: audit 2021-01-28T04:16:51.648089+0000 mgr.y (mgr.14138) 544 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:53.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:52 smithi134 bash[9858]: cluster 2021-01-28T04:16:51.890634+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-28T04:16:53.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:52 smithi150 bash[9867]: cluster 2021-01-28T04:16:51.037689+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v463: 180 pgs: 180 active+clean; 25 KiB data, 136 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:53.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:52 smithi150 bash[9867]: audit 2021-01-28T04:16:51.648089+0000 mgr.y (mgr.14138) 544 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:53.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:52 smithi150 bash[9867]: cluster 2021-01-28T04:16:51.890634+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-28T04:16:53.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:52 smithi150 bash[13629]: cluster 2021-01-28T04:16:51.037689+0000 mgr.y (mgr.14138) 543 : cluster [DBG] pgmap v463: 180 pgs: 180 active+clean; 25 KiB data, 136 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:16:53.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:52 smithi150 bash[13629]: audit 2021-01-28T04:16:51.648089+0000 mgr.y (mgr.14138) 544 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:16:53.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:52 smithi150 bash[13629]: cluster 2021-01-28T04:16:51.890634+0000 mon.a (mon.0) 832 : cluster [DBG] osdmap e129: 8 total, 8 up, 8 in 2021-01-28T04:16:54.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:53 smithi150 bash[9867]: cluster 2021-01-28T04:16:52.898114+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-28T04:16:54.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:53 smithi150 bash[9867]: audit 2021-01-28T04:16:52.955444+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.150:0/1284308134' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:54.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:53 smithi150 bash[9867]: audit 2021-01-28T04:16:52.956051+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:54.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:53 smithi150 bash[13629]: cluster 2021-01-28T04:16:52.898114+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-28T04:16:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:53 smithi150 bash[13629]: audit 2021-01-28T04:16:52.955444+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.150:0/1284308134' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:54.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:53 smithi150 bash[13629]: audit 2021-01-28T04:16:52.956051+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:54.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:53 smithi134 bash[9858]: cluster 2021-01-28T04:16:52.898114+0000 mon.a (mon.0) 833 : cluster [DBG] osdmap e130: 8 total, 8 up, 8 in 2021-01-28T04:16:54.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:53 smithi134 bash[9858]: audit 2021-01-28T04:16:52.955444+0000 mon.c (mon.1) 41 : audit [INF] from='client.? 172.21.15.150:0/1284308134' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:54.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:53 smithi134 bash[9858]: audit 2021-01-28T04:16:52.956051+0000 mon.a (mon.0) 834 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:54.907 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_stat ... ok 2021-01-28T04:16:55.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:54 smithi150 bash[9867]: cluster 2021-01-28T04:16:53.038957+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v466: 212 pgs: 10 creating+peering, 15 unknown, 187 active+clean; 25 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:55.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:54 smithi150 bash[9867]: audit 2021-01-28T04:16:53.903329+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:55.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:54 smithi150 bash[9867]: cluster 2021-01-28T04:16:53.903526+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-28T04:16:55.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:54 smithi150 bash[9867]: cluster 2021-01-28T04:16:54.903573+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-28T04:16:55.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:54 smithi150 bash[13629]: cluster 2021-01-28T04:16:53.038957+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v466: 212 pgs: 10 creating+peering, 15 unknown, 187 active+clean; 25 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:55.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:54 smithi150 bash[13629]: audit 2021-01-28T04:16:53.903329+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:55.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:54 smithi150 bash[13629]: cluster 2021-01-28T04:16:53.903526+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-28T04:16:55.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:54 smithi150 bash[13629]: cluster 2021-01-28T04:16:54.903573+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-28T04:16:55.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:54 smithi134 bash[9858]: cluster 2021-01-28T04:16:53.038957+0000 mgr.y (mgr.14138) 545 : cluster [DBG] pgmap v466: 212 pgs: 10 creating+peering, 15 unknown, 187 active+clean; 25 KiB data, 141 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:55.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:54 smithi134 bash[9858]: audit 2021-01-28T04:16:53.903329+0000 mon.a (mon.0) 835 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:55.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:54 smithi134 bash[9858]: cluster 2021-01-28T04:16:53.903526+0000 mon.a (mon.0) 836 : cluster [DBG] osdmap e131: 8 total, 8 up, 8 in 2021-01-28T04:16:55.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:54 smithi134 bash[9858]: cluster 2021-01-28T04:16:54.903573+0000 mon.a (mon.0) 837 : cluster [DBG] osdmap e132: 8 total, 8 up, 8 in 2021-01-28T04:16:57.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:56 smithi150 bash[9867]: cluster 2021-01-28T04:16:55.039648+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v469: 180 pgs: 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:57.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:56 smithi150 bash[9867]: cluster 2021-01-28T04:16:55.927203+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-28T04:16:57.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:56 smithi150 bash[13629]: cluster 2021-01-28T04:16:55.039648+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v469: 180 pgs: 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:57.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:56 smithi150 bash[13629]: cluster 2021-01-28T04:16:55.927203+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-28T04:16:57.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:56 smithi134 bash[9858]: cluster 2021-01-28T04:16:55.039648+0000 mgr.y (mgr.14138) 546 : cluster [DBG] pgmap v469: 180 pgs: 180 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:57.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:56 smithi134 bash[9858]: cluster 2021-01-28T04:16:55.927203+0000 mon.a (mon.0) 838 : cluster [DBG] osdmap e133: 8 total, 8 up, 8 in 2021-01-28T04:16:58.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:57 smithi150 bash[9867]: cluster 2021-01-28T04:16:56.940414+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-28T04:16:58.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:57 smithi150 bash[9867]: audit 2021-01-28T04:16:56.997151+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:58.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:57 smithi150 bash[9867]: audit 2021-01-28T04:16:56.998175+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.150:0/2039592830' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:58.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:57 smithi150 bash[13629]: cluster 2021-01-28T04:16:56.940414+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-28T04:16:58.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:57 smithi150 bash[13629]: audit 2021-01-28T04:16:56.997151+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:58.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:57 smithi150 bash[13629]: audit 2021-01-28T04:16:56.998175+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.150:0/2039592830' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:58.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:57 smithi134 bash[9858]: cluster 2021-01-28T04:16:56.940414+0000 mon.a (mon.0) 839 : cluster [DBG] osdmap e134: 8 total, 8 up, 8 in 2021-01-28T04:16:58.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:57 smithi134 bash[9858]: audit 2021-01-28T04:16:56.997151+0000 mon.a (mon.0) 840 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:58.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:57 smithi134 bash[9858]: audit 2021-01-28T04:16:56.998175+0000 mon.b (mon.2) 22 : audit [INF] from='client.? 172.21.15.150:0/2039592830' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:16:58.959 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_write ... ok 2021-01-28T04:16:59.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:58 smithi150 bash[9867]: cluster 2021-01-28T04:16:57.040696+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v472: 212 pgs: 2 creating+activating, 28 unknown, 182 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:59.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:58 smithi150 bash[9867]: audit 2021-01-28T04:16:57.951818+0000 mon.a (mon.0) 841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:59.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:58 smithi150 bash[9867]: cluster 2021-01-28T04:16:57.951919+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-28T04:16:59.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:58 smithi150 bash[13629]: cluster 2021-01-28T04:16:57.040696+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v472: 212 pgs: 2 creating+activating, 28 unknown, 182 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:59.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:58 smithi150 bash[13629]: audit 2021-01-28T04:16:57.951818+0000 mon.a (mon.0) 841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:59.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:58 smithi150 bash[13629]: cluster 2021-01-28T04:16:57.951919+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-28T04:16:59.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:58 smithi134 bash[9858]: cluster 2021-01-28T04:16:57.040696+0000 mgr.y (mgr.14138) 547 : cluster [DBG] pgmap v472: 212 pgs: 2 creating+activating, 28 unknown, 182 active+clean; 25 KiB data, 142 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:16:59.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:58 smithi134 bash[9858]: audit 2021-01-28T04:16:57.951818+0000 mon.a (mon.0) 841 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:16:59.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:58 smithi134 bash[9858]: cluster 2021-01-28T04:16:57.951919+0000 mon.a (mon.0) 842 : cluster [DBG] osdmap e135: 8 total, 8 up, 8 in 2021-01-28T04:17:00.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:16:59 smithi150 bash[9867]: cluster 2021-01-28T04:16:58.955285+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-28T04:17:00.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:16:59 smithi150 bash[13629]: cluster 2021-01-28T04:16:58.955285+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-28T04:17:00.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:16:59 smithi134 bash[9858]: cluster 2021-01-28T04:16:58.955285+0000 mon.a (mon.0) 843 : cluster [DBG] osdmap e136: 8 total, 8 up, 8 in 2021-01-28T04:17:01.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:00 smithi134 bash[9858]: cluster 2021-01-28T04:16:59.041492+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v475: 180 pgs: 180 active+clean; 25 KiB data, 147 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:01.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:00 smithi134 bash[9858]: cluster 2021-01-28T04:16:59.977106+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-28T04:17:01.391 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:00 smithi150 bash[9867]: cluster 2021-01-28T04:16:59.041492+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v475: 180 pgs: 180 active+clean; 25 KiB data, 147 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:01.391 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:00 smithi150 bash[9867]: cluster 2021-01-28T04:16:59.977106+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-28T04:17:01.391 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:00 smithi150 bash[13629]: cluster 2021-01-28T04:16:59.041492+0000 mgr.y (mgr.14138) 548 : cluster [DBG] pgmap v475: 180 pgs: 180 active+clean; 25 KiB data, 147 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:01.392 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:00 smithi150 bash[13629]: cluster 2021-01-28T04:16:59.977106+0000 mon.a (mon.0) 844 : cluster [DBG] osdmap e137: 8 total, 8 up, 8 in 2021-01-28T04:17:01.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:17:01 smithi150 bash[10146]: debug 2021-01-28T04:17:01.655+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:17:02.007 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:17:01 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:17:02.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:02 smithi134 bash[9858]: cluster 2021-01-28T04:17:00.982659+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-28T04:17:02.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:02 smithi134 bash[9858]: audit 2021-01-28T04:17:01.046717+0000 mon.a (mon.0) 846 : audit [INF] from='client.? 172.21.15.150:0/2740095116' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:02.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:02 smithi150 bash[9867]: cluster 2021-01-28T04:17:00.982659+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-28T04:17:02.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:02 smithi150 bash[9867]: audit 2021-01-28T04:17:01.046717+0000 mon.a (mon.0) 846 : audit [INF] from='client.? 172.21.15.150:0/2740095116' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:02.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:02 smithi150 bash[13629]: cluster 2021-01-28T04:17:00.982659+0000 mon.a (mon.0) 845 : cluster [DBG] osdmap e138: 8 total, 8 up, 8 in 2021-01-28T04:17:02.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:02 smithi150 bash[13629]: audit 2021-01-28T04:17:01.046717+0000 mon.a (mon.0) 846 : audit [INF] from='client.? 172.21.15.150:0/2740095116' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:03.010 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_write_full ... ok 2021-01-28T04:17:03.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:03 smithi134 bash[9858]: cluster 2021-01-28T04:17:01.042156+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v478: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 147 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:03 smithi134 bash[9858]: audit 2021-01-28T04:17:01.659382+0000 mgr.y (mgr.14138) 550 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:03.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:03 smithi134 bash[9858]: audit 2021-01-28T04:17:02.000279+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.150:0/2740095116' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:03.389 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:03 smithi134 bash[9858]: cluster 2021-01-28T04:17:02.000450+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-28T04:17:03.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:03 smithi150 bash[9867]: cluster 2021-01-28T04:17:01.042156+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v478: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 147 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:03.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:03 smithi150 bash[9867]: audit 2021-01-28T04:17:01.659382+0000 mgr.y (mgr.14138) 550 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:03.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:03 smithi150 bash[9867]: audit 2021-01-28T04:17:02.000279+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.150:0/2740095116' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:03.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:03 smithi150 bash[9867]: cluster 2021-01-28T04:17:02.000450+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-28T04:17:03.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:03 smithi150 bash[13629]: cluster 2021-01-28T04:17:01.042156+0000 mgr.y (mgr.14138) 549 : cluster [DBG] pgmap v478: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 147 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:03.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:03 smithi150 bash[13629]: audit 2021-01-28T04:17:01.659382+0000 mgr.y (mgr.14138) 550 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:03.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:03 smithi150 bash[13629]: audit 2021-01-28T04:17:02.000279+0000 mon.a (mon.0) 847 : audit [INF] from='client.? 172.21.15.150:0/2740095116' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:03.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:03 smithi150 bash[13629]: cluster 2021-01-28T04:17:02.000450+0000 mon.a (mon.0) 848 : cluster [DBG] osdmap e139: 8 total, 8 up, 8 in 2021-01-28T04:17:04.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:04 smithi134 bash[9858]: cluster 2021-01-28T04:17:03.005960+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-28T04:17:04.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:04 smithi150 bash[9867]: cluster 2021-01-28T04:17:03.005960+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-28T04:17:04.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:04 smithi150 bash[13629]: cluster 2021-01-28T04:17:03.005960+0000 mon.a (mon.0) 849 : cluster [DBG] osdmap e140: 8 total, 8 up, 8 in 2021-01-28T04:17:05.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:05 smithi134 bash[9858]: cluster 2021-01-28T04:17:03.042683+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v481: 180 pgs: 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:05.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:05 smithi134 bash[9858]: cluster 2021-01-28T04:17:04.027960+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-28T04:17:05.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:05 smithi150 bash[9867]: cluster 2021-01-28T04:17:03.042683+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v481: 180 pgs: 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:05.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:05 smithi150 bash[9867]: cluster 2021-01-28T04:17:04.027960+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-28T04:17:05.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:05 smithi150 bash[13629]: cluster 2021-01-28T04:17:03.042683+0000 mgr.y (mgr.14138) 551 : cluster [DBG] pgmap v481: 180 pgs: 180 active+clean; 25 KiB data, 148 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:05.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:05 smithi150 bash[13629]: cluster 2021-01-28T04:17:04.027960+0000 mon.a (mon.0) 850 : cluster [DBG] osdmap e141: 8 total, 8 up, 8 in 2021-01-28T04:17:06.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:06 smithi134 bash[9858]: cluster 2021-01-28T04:17:05.044148+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-28T04:17:06.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:06 smithi134 bash[9858]: audit 2021-01-28T04:17:05.103932+0000 mon.a (mon.0) 852 : audit [INF] from='client.? 172.21.15.150:0/867705330' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:06.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:06 smithi150 bash[9867]: cluster 2021-01-28T04:17:05.044148+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-28T04:17:06.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:06 smithi150 bash[9867]: audit 2021-01-28T04:17:05.103932+0000 mon.a (mon.0) 852 : audit [INF] from='client.? 172.21.15.150:0/867705330' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:06.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:06 smithi150 bash[13629]: cluster 2021-01-28T04:17:05.044148+0000 mon.a (mon.0) 851 : cluster [DBG] osdmap e142: 8 total, 8 up, 8 in 2021-01-28T04:17:06.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:06 smithi150 bash[13629]: audit 2021-01-28T04:17:05.103932+0000 mon.a (mon.0) 852 : audit [INF] from='client.? 172.21.15.150:0/867705330' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:07.059 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_write_no_comp_ref ... ok 2021-01-28T04:17:07.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:07 smithi134 bash[9858]: cluster 2021-01-28T04:17:05.043225+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v484: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:07.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:07 smithi134 bash[9858]: audit 2021-01-28T04:17:06.047646+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.150:0/867705330' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:07.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:07 smithi134 bash[9858]: cluster 2021-01-28T04:17:06.047768+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-28T04:17:07.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:07 smithi150 bash[13629]: cluster 2021-01-28T04:17:05.043225+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v484: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:07.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:07 smithi150 bash[13629]: audit 2021-01-28T04:17:06.047646+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.150:0/867705330' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:07.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:07 smithi150 bash[13629]: cluster 2021-01-28T04:17:06.047768+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-28T04:17:07.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:07 smithi150 bash[9867]: cluster 2021-01-28T04:17:05.043225+0000 mgr.y (mgr.14138) 552 : cluster [DBG] pgmap v484: 212 pgs: 6 creating+peering, 26 unknown, 180 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:07.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:07 smithi150 bash[9867]: audit 2021-01-28T04:17:06.047646+0000 mon.a (mon.0) 853 : audit [INF] from='client.? 172.21.15.150:0/867705330' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:07.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:07 smithi150 bash[9867]: cluster 2021-01-28T04:17:06.047768+0000 mon.a (mon.0) 854 : cluster [DBG] osdmap e143: 8 total, 8 up, 8 in 2021-01-28T04:17:08.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:08 smithi134 bash[9858]: cluster 2021-01-28T04:17:07.044229+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v486: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:08.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:08 smithi134 bash[9858]: cluster 2021-01-28T04:17:07.050740+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-28T04:17:08.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:08 smithi150 bash[9867]: cluster 2021-01-28T04:17:07.044229+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v486: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:08.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:08 smithi150 bash[9867]: cluster 2021-01-28T04:17:07.050740+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-28T04:17:08.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:08 smithi150 bash[13629]: cluster 2021-01-28T04:17:07.044229+0000 mgr.y (mgr.14138) 553 : cluster [DBG] pgmap v486: 212 pgs: 6 creating+peering, 18 unknown, 188 active+clean; 25 KiB data, 149 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:08.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:08 smithi150 bash[13629]: cluster 2021-01-28T04:17:07.050740+0000 mon.a (mon.0) 855 : cluster [DBG] osdmap e144: 8 total, 8 up, 8 in 2021-01-28T04:17:09.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:09 smithi134 bash[9858]: cluster 2021-01-28T04:17:08.072717+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-28T04:17:09.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:09 smithi150 bash[9867]: cluster 2021-01-28T04:17:08.072717+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-28T04:17:09.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:09 smithi150 bash[13629]: cluster 2021-01-28T04:17:08.072717+0000 mon.a (mon.0) 856 : cluster [DBG] osdmap e145: 8 total, 8 up, 8 in 2021-01-28T04:17:10.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:10 smithi134 bash[9858]: cluster 2021-01-28T04:17:09.045428+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v489: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:10.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:10 smithi134 bash[9858]: cluster 2021-01-28T04:17:09.083800+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-28T04:17:10.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:10 smithi134 bash[9858]: audit 2021-01-28T04:17:09.192827+0000 mon.a (mon.0) 858 : audit [INF] from='client.? 172.21.15.150:0/1536722146' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:10.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:10 smithi150 bash[13629]: cluster 2021-01-28T04:17:09.045428+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v489: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:10.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:10 smithi150 bash[13629]: cluster 2021-01-28T04:17:09.083800+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-28T04:17:10.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:10 smithi150 bash[13629]: audit 2021-01-28T04:17:09.192827+0000 mon.a (mon.0) 858 : audit [INF] from='client.? 172.21.15.150:0/1536722146' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:10.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:10 smithi150 bash[9867]: cluster 2021-01-28T04:17:09.045428+0000 mgr.y (mgr.14138) 554 : cluster [DBG] pgmap v489: 212 pgs: 9 creating+peering, 23 unknown, 180 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:10.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:10 smithi150 bash[9867]: cluster 2021-01-28T04:17:09.083800+0000 mon.a (mon.0) 857 : cluster [DBG] osdmap e146: 8 total, 8 up, 8 in 2021-01-28T04:17:10.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:10 smithi150 bash[9867]: audit 2021-01-28T04:17:09.192827+0000 mon.a (mon.0) 858 : audit [INF] from='client.? 172.21.15.150:0/1536722146' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:11.098 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_aio_writesame ... ok 2021-01-28T04:17:11.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:11 smithi134 bash[9858]: audit 2021-01-28T04:17:10.089012+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.150:0/1536722146' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:11.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:11 smithi134 bash[9858]: cluster 2021-01-28T04:17:10.089100+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-28T04:17:11.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:11 smithi134 bash[9858]: cluster 2021-01-28T04:17:11.090891+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-28T04:17:11.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:11 smithi150 bash[13629]: audit 2021-01-28T04:17:10.089012+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.150:0/1536722146' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:11.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:11 smithi150 bash[13629]: cluster 2021-01-28T04:17:10.089100+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-28T04:17:11.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:11 smithi150 bash[13629]: cluster 2021-01-28T04:17:11.090891+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-28T04:17:11.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:11 smithi150 bash[9867]: audit 2021-01-28T04:17:10.089012+0000 mon.a (mon.0) 859 : audit [INF] from='client.? 172.21.15.150:0/1536722146' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:11.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:11 smithi150 bash[9867]: cluster 2021-01-28T04:17:10.089100+0000 mon.a (mon.0) 860 : cluster [DBG] osdmap e147: 8 total, 8 up, 8 in 2021-01-28T04:17:11.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:11 smithi150 bash[9867]: cluster 2021-01-28T04:17:11.090891+0000 mon.a (mon.0) 861 : cluster [DBG] osdmap e148: 8 total, 8 up, 8 in 2021-01-28T04:17:11.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:17:11 smithi150 bash[10146]: debug 2021-01-28T04:17:11.659+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:17:12.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:17:11 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:17:12.975 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[13629]: cluster 2021-01-28T04:17:11.046237+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v492: 212 pgs: 9 creating+peering, 20 unknown, 183 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:12.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[13629]: audit 2021-01-28T04:17:11.663816+0000 mgr.y (mgr.14138) 556 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:12.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[13629]: cluster 2021-01-28T04:17:12.119163+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-28T04:17:12.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[13629]: audit 2021-01-28T04:17:12.128147+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.150:0/893630378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:12.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[13629]: audit 2021-01-28T04:17:12.128994+0000 mon.a (mon.0) 863 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:12.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[9867]: cluster 2021-01-28T04:17:11.046237+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v492: 212 pgs: 9 creating+peering, 20 unknown, 183 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:12.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[9867]: audit 2021-01-28T04:17:11.663816+0000 mgr.y (mgr.14138) 556 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:12.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[9867]: cluster 2021-01-28T04:17:12.119163+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-28T04:17:12.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[9867]: audit 2021-01-28T04:17:12.128147+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.150:0/893630378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:12.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:12 smithi150 bash[9867]: audit 2021-01-28T04:17:12.128994+0000 mon.a (mon.0) 863 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:13.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:12 smithi134 bash[9858]: cluster 2021-01-28T04:17:11.046237+0000 mgr.y (mgr.14138) 555 : cluster [DBG] pgmap v492: 212 pgs: 9 creating+peering, 20 unknown, 183 active+clean; 25 KiB data, 151 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:13.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:12 smithi134 bash[9858]: audit 2021-01-28T04:17:11.663816+0000 mgr.y (mgr.14138) 556 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:12 smithi134 bash[9858]: cluster 2021-01-28T04:17:12.119163+0000 mon.a (mon.0) 862 : cluster [DBG] osdmap e149: 8 total, 8 up, 8 in 2021-01-28T04:17:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:12 smithi134 bash[9858]: audit 2021-01-28T04:17:12.128147+0000 mon.c (mon.1) 42 : audit [INF] from='client.? 172.21.15.150:0/893630378' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:12 smithi134 bash[9858]: audit 2021-01-28T04:17:12.128994+0000 mon.a (mon.0) 863 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:14.128 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_alignment ... ok 2021-01-28T04:17:14.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:14 smithi134 bash[9858]: cluster 2021-01-28T04:17:13.047651+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v495: 212 pgs: 15 creating+peering, 17 unknown, 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:14.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:14 smithi134 bash[9858]: audit 2021-01-28T04:17:13.123968+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:14.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:14 smithi134 bash[9858]: cluster 2021-01-28T04:17:13.124325+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-28T04:17:14.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:14 smithi150 bash[9867]: cluster 2021-01-28T04:17:13.047651+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v495: 212 pgs: 15 creating+peering, 17 unknown, 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:14.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:14 smithi150 bash[9867]: audit 2021-01-28T04:17:13.123968+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:14.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:14 smithi150 bash[9867]: cluster 2021-01-28T04:17:13.124325+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-28T04:17:14.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:14 smithi150 bash[13629]: cluster 2021-01-28T04:17:13.047651+0000 mgr.y (mgr.14138) 557 : cluster [DBG] pgmap v495: 212 pgs: 15 creating+peering, 17 unknown, 180 active+clean; 25 KiB data, 152 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:14.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:14 smithi150 bash[13629]: audit 2021-01-28T04:17:13.123968+0000 mon.a (mon.0) 864 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:14.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:14 smithi150 bash[13629]: cluster 2021-01-28T04:17:13.124325+0000 mon.a (mon.0) 865 : cluster [DBG] osdmap e150: 8 total, 8 up, 8 in 2021-01-28T04:17:15.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:15 smithi150 bash[9867]: cluster 2021-01-28T04:17:14.124282+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-28T04:17:15.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:15 smithi150 bash[13629]: cluster 2021-01-28T04:17:14.124282+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-28T04:17:15.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:15 smithi134 bash[9858]: cluster 2021-01-28T04:17:14.124282+0000 mon.a (mon.0) 866 : cluster [DBG] osdmap e151: 8 total, 8 up, 8 in 2021-01-28T04:17:16.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:16 smithi150 bash[9867]: cluster 2021-01-28T04:17:15.048629+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v498: 180 pgs: 180 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:16.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:16 smithi150 bash[9867]: cluster 2021-01-28T04:17:15.152778+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-28T04:17:16.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:16 smithi150 bash[13629]: cluster 2021-01-28T04:17:15.048629+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v498: 180 pgs: 180 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:16.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:16 smithi150 bash[13629]: cluster 2021-01-28T04:17:15.152778+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-28T04:17:16.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:16 smithi134 bash[9858]: cluster 2021-01-28T04:17:15.048629+0000 mgr.y (mgr.14138) 558 : cluster [DBG] pgmap v498: 180 pgs: 180 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:16.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:16 smithi134 bash[9858]: cluster 2021-01-28T04:17:15.152778+0000 mon.a (mon.0) 867 : cluster [DBG] osdmap e152: 8 total, 8 up, 8 in 2021-01-28T04:17:17.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:17 smithi150 bash[9867]: cluster 2021-01-28T04:17:16.162370+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-28T04:17:17.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:17 smithi150 bash[9867]: audit 2021-01-28T04:17:16.201659+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.150:0/2492275066' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:17.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:17 smithi150 bash[9867]: audit 2021-01-28T04:17:16.202094+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:17.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:17 smithi150 bash[13629]: cluster 2021-01-28T04:17:16.162370+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-28T04:17:17.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:17 smithi150 bash[13629]: audit 2021-01-28T04:17:16.201659+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.150:0/2492275066' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:17.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:17 smithi150 bash[13629]: audit 2021-01-28T04:17:16.202094+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:17.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:17 smithi134 bash[9858]: cluster 2021-01-28T04:17:16.162370+0000 mon.a (mon.0) 868 : cluster [DBG] osdmap e153: 8 total, 8 up, 8 in 2021-01-28T04:17:17.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:17 smithi134 bash[9858]: audit 2021-01-28T04:17:16.201659+0000 mon.c (mon.1) 43 : audit [INF] from='client.? 172.21.15.150:0/2492275066' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:17.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:17 smithi134 bash[9858]: audit 2021-01-28T04:17:16.202094+0000 mon.a (mon.0) 869 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:18.198 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_append ... ok 2021-01-28T04:17:18.475 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:18 smithi150 bash[13629]: cluster 2021-01-28T04:17:17.049637+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v501: 212 pgs: 30 unknown, 182 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:18.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:18 smithi150 bash[13629]: audit 2021-01-28T04:17:17.174102+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:18.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:18 smithi150 bash[13629]: cluster 2021-01-28T04:17:17.174192+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-28T04:17:18.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:18 smithi150 bash[9867]: cluster 2021-01-28T04:17:17.049637+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v501: 212 pgs: 30 unknown, 182 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:18.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:18 smithi150 bash[9867]: audit 2021-01-28T04:17:17.174102+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:18.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:18 smithi150 bash[9867]: cluster 2021-01-28T04:17:17.174192+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-28T04:17:18.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:18 smithi134 bash[9858]: cluster 2021-01-28T04:17:17.049637+0000 mgr.y (mgr.14138) 559 : cluster [DBG] pgmap v501: 212 pgs: 30 unknown, 182 active+clean; 25 KiB data, 153 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:18.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:18 smithi134 bash[9858]: audit 2021-01-28T04:17:17.174102+0000 mon.a (mon.0) 870 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:18.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:18 smithi134 bash[9858]: cluster 2021-01-28T04:17:17.174192+0000 mon.a (mon.0) 871 : cluster [DBG] osdmap e154: 8 total, 8 up, 8 in 2021-01-28T04:17:19.475 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:19 smithi150 bash[9867]: cluster 2021-01-28T04:17:18.188974+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-28T04:17:19.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:19 smithi150 bash[13629]: cluster 2021-01-28T04:17:18.188974+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-28T04:17:19.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:19 smithi134 bash[9858]: cluster 2021-01-28T04:17:18.188974+0000 mon.a (mon.0) 872 : cluster [DBG] osdmap e155: 8 total, 8 up, 8 in 2021-01-28T04:17:20.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:20 smithi150 bash[9867]: cluster 2021-01-28T04:17:19.050764+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v504: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:20.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:20 smithi150 bash[9867]: cluster 2021-01-28T04:17:19.208231+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-28T04:17:20.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:20 smithi150 bash[9867]: audit 2021-01-28T04:17:19.213558+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:17:20.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:20 smithi150 bash[9867]: audit 2021-01-28T04:17:19.217556+0000 mon.a (mon.0) 875 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-28T04:17:20.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:20 smithi150 bash[13629]: cluster 2021-01-28T04:17:19.050764+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v504: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:20.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:20 smithi150 bash[13629]: cluster 2021-01-28T04:17:19.208231+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-28T04:17:20.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:20 smithi150 bash[13629]: audit 2021-01-28T04:17:19.213558+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:17:20.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:20 smithi150 bash[13629]: audit 2021-01-28T04:17:19.217556+0000 mon.a (mon.0) 875 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-28T04:17:20.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:20 smithi134 bash[9858]: cluster 2021-01-28T04:17:19.050764+0000 mgr.y (mgr.14138) 560 : cluster [DBG] pgmap v504: 180 pgs: 180 active+clean; 25 KiB data, 154 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:20.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:20 smithi134 bash[9858]: cluster 2021-01-28T04:17:19.208231+0000 mon.a (mon.0) 873 : cluster [DBG] osdmap e156: 8 total, 8 up, 8 in 2021-01-28T04:17:20.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:20 smithi134 bash[9858]: audit 2021-01-28T04:17:19.213558+0000 mon.a (mon.0) 874 : audit [DBG] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2021-01-28T04:17:20.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:20 smithi134 bash[9858]: audit 2021-01-28T04:17:19.217556+0000 mon.a (mon.0) 875 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]: dispatch 2021-01-28T04:17:21.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: audit 2021-01-28T04:17:20.209920+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-28T04:17:21.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: cluster 2021-01-28T04:17:20.210888+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-28T04:17:21.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: audit 2021-01-28T04:17:20.214166+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-28T04:17:21.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: audit 2021-01-28T04:17:20.215146+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:17:21.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: audit 2021-01-28T04:17:21.034794+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:17:21.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: audit 2021-01-28T04:17:21.035885+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:17:21.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: audit 2021-01-28T04:17:21.210966+0000 mon.a (mon.0) 882 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:17:21.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: cluster 2021-01-28T04:17:21.211124+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-28T04:17:21.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: audit 2021-01-28T04:17:21.213457+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-28T04:17:21.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[9858]: audit 2021-01-28T04:17:21.214113+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-28T04:17:21.673 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: audit 2021-01-28T04:17:20.209920+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-28T04:17:21.673 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: cluster 2021-01-28T04:17:20.210888+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-28T04:17:21.673 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: audit 2021-01-28T04:17:20.214166+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-28T04:17:21.674 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: audit 2021-01-28T04:17:20.215146+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:17:21.674 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: audit 2021-01-28T04:17:21.034794+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:17:21.675 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: audit 2021-01-28T04:17:21.035885+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:17:21.675 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: audit 2021-01-28T04:17:21.210966+0000 mon.a (mon.0) 882 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:17:21.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: cluster 2021-01-28T04:17:21.211124+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-28T04:17:21.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: audit 2021-01-28T04:17:21.213457+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-28T04:17:21.676 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[9867]: audit 2021-01-28T04:17:21.214113+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-28T04:17:21.677 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: audit 2021-01-28T04:17:20.209920+0000 mon.a (mon.0) 876 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app1"}]': finished 2021-01-28T04:17:21.677 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: cluster 2021-01-28T04:17:20.210888+0000 mon.a (mon.0) 877 : cluster [DBG] osdmap e157: 8 total, 8 up, 8 in 2021-01-28T04:17:21.678 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: audit 2021-01-28T04:17:20.214166+0000 mon.a (mon.0) 878 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2"}]: dispatch 2021-01-28T04:17:21.678 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: audit 2021-01-28T04:17:20.215146+0000 mon.a (mon.0) 879 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]: dispatch 2021-01-28T04:17:21.679 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: audit 2021-01-28T04:17:21.034794+0000 mon.a (mon.0) 880 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:17:21.679 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: audit 2021-01-28T04:17:21.035885+0000 mon.a (mon.0) 881 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:17:21.680 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: audit 2021-01-28T04:17:21.210966+0000 mon.a (mon.0) 882 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "test_pool","app": "app2","yes_i_really_mean_it": true}]': finished 2021-01-28T04:17:21.680 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: cluster 2021-01-28T04:17:21.211124+0000 mon.a (mon.0) 883 : cluster [DBG] osdmap e158: 8 total, 8 up, 8 in 2021-01-28T04:17:21.681 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: audit 2021-01-28T04:17:21.213457+0000 mon.a (mon.0) 884 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"dne","key":"key","value":"key"}]: dispatch 2021-01-28T04:17:21.681 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[13629]: audit 2021-01-28T04:17:21.214113+0000 mon.a (mon.0) 885 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]: dispatch 2021-01-28T04:17:21.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:17:21 smithi150 bash[10146]: debug 2021-01-28T04:17:21.670+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:17:22.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:17:21 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:17:22.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[9867]: cluster 2021-01-28T04:17:21.051430+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v507: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:22.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[9867]: audit 2021-01-28T04:17:21.671890+0000 mgr.y (mgr.14138) 562 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:22.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[9867]: audit 2021-01-28T04:17:22.218237+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-28T04:17:22.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[9867]: cluster 2021-01-28T04:17:22.218424+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-28T04:17:22.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[9867]: audit 2021-01-28T04:17:22.220238+0000 mon.a (mon.0) 888 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-28T04:17:22.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[13629]: cluster 2021-01-28T04:17:21.051430+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v507: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:22.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[13629]: audit 2021-01-28T04:17:21.671890+0000 mgr.y (mgr.14138) 562 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:22.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[13629]: audit 2021-01-28T04:17:22.218237+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-28T04:17:22.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[13629]: cluster 2021-01-28T04:17:22.218424+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-28T04:17:22.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:22 smithi150 bash[13629]: audit 2021-01-28T04:17:22.220238+0000 mon.a (mon.0) 888 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-28T04:17:23.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:22 smithi134 bash[9858]: cluster 2021-01-28T04:17:21.051430+0000 mgr.y (mgr.14138) 561 : cluster [DBG] pgmap v507: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 155 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:23.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:22 smithi134 bash[9858]: audit 2021-01-28T04:17:21.671890+0000 mgr.y (mgr.14138) 562 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:23.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:22 smithi134 bash[9858]: audit 2021-01-28T04:17:22.218237+0000 mon.a (mon.0) 886 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key1","value":"val1"}]': finished 2021-01-28T04:17:23.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:22 smithi134 bash[9858]: cluster 2021-01-28T04:17:22.218424+0000 mon.a (mon.0) 887 : cluster [DBG] osdmap e159: 8 total, 8 up, 8 in 2021-01-28T04:17:23.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:22 smithi134 bash[9858]: audit 2021-01-28T04:17:22.220238+0000 mon.a (mon.0) 888 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]: dispatch 2021-01-28T04:17:24.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:24 smithi150 bash[9867]: cluster 2021-01-28T04:17:23.052796+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v510: 212 pgs: 5 creating+peering, 8 unknown, 199 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:24.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:24 smithi150 bash[9867]: audit 2021-01-28T04:17:23.217656+0000 mon.a (mon.0) 889 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-28T04:17:24.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:24 smithi150 bash[9867]: cluster 2021-01-28T04:17:23.217856+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-28T04:17:24.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:24 smithi150 bash[9867]: audit 2021-01-28T04:17:23.221923+0000 mon.a (mon.0) 891 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-28T04:17:24.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:24 smithi150 bash[13629]: cluster 2021-01-28T04:17:23.052796+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v510: 212 pgs: 5 creating+peering, 8 unknown, 199 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:24.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:24 smithi150 bash[13629]: audit 2021-01-28T04:17:23.217656+0000 mon.a (mon.0) 889 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-28T04:17:24.479 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:24 smithi150 bash[13629]: cluster 2021-01-28T04:17:23.217856+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-28T04:17:24.479 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:24 smithi150 bash[13629]: audit 2021-01-28T04:17:23.221923+0000 mon.a (mon.0) 891 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-28T04:17:24.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:24 smithi134 bash[9858]: cluster 2021-01-28T04:17:23.052796+0000 mgr.y (mgr.14138) 563 : cluster [DBG] pgmap v510: 212 pgs: 5 creating+peering, 8 unknown, 199 active+clean; 25 KiB data, 156 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:24.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:24 smithi134 bash[9858]: audit 2021-01-28T04:17:23.217656+0000 mon.a (mon.0) 889 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app1","key":"key2","value":"val2"}]': finished 2021-01-28T04:17:24.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:24 smithi134 bash[9858]: cluster 2021-01-28T04:17:23.217856+0000 mon.a (mon.0) 890 : cluster [DBG] osdmap e160: 8 total, 8 up, 8 in 2021-01-28T04:17:24.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:24 smithi134 bash[9858]: audit 2021-01-28T04:17:23.221923+0000 mon.a (mon.0) 891 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]: dispatch 2021-01-28T04:17:25.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:25 smithi134 bash[9858]: audit 2021-01-28T04:17:24.219897+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-28T04:17:25.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:25 smithi134 bash[9858]: cluster 2021-01-28T04:17:24.220070+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-28T04:17:25.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:25 smithi134 bash[9858]: audit 2021-01-28T04:17:24.224521+0000 mon.a (mon.0) 894 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:17:25.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:25 smithi134 bash[9858]: audit 2021-01-28T04:17:25.224210+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-28T04:17:25.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:25 smithi134 bash[9858]: cluster 2021-01-28T04:17:25.224376+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-28T04:17:25.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[9867]: audit 2021-01-28T04:17:24.219897+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-28T04:17:25.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[9867]: cluster 2021-01-28T04:17:24.220070+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-28T04:17:25.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[9867]: audit 2021-01-28T04:17:24.224521+0000 mon.a (mon.0) 894 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:17:25.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[9867]: audit 2021-01-28T04:17:25.224210+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-28T04:17:25.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[9867]: cluster 2021-01-28T04:17:25.224376+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-28T04:17:25.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[13629]: audit 2021-01-28T04:17:24.219897+0000 mon.a (mon.0) 892 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application set","pool":"test_pool","app":"app2","key":"key1","value":"val1"}]': finished 2021-01-28T04:17:25.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[13629]: cluster 2021-01-28T04:17:24.220070+0000 mon.a (mon.0) 893 : cluster [DBG] osdmap e161: 8 total, 8 up, 8 in 2021-01-28T04:17:25.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[13629]: audit 2021-01-28T04:17:24.224521+0000 mon.a (mon.0) 894 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]: dispatch 2021-01-28T04:17:25.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[13629]: audit 2021-01-28T04:17:25.224210+0000 mon.a (mon.0) 895 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix":"osd pool application rm","pool":"test_pool","app":"app1","key":"key1"}]': finished 2021-01-28T04:17:25.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:25 smithi150 bash[13629]: cluster 2021-01-28T04:17:25.224376+0000 mon.a (mon.0) 896 : cluster [DBG] osdmap e162: 8 total, 8 up, 8 in 2021-01-28T04:17:26.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:26 smithi134 bash[9858]: cluster 2021-01-28T04:17:25.053812+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v513: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:26.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:26 smithi134 bash[9858]: audit 2021-01-28T04:17:25.231220+0000 mon.a (mon.0) 897 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:26.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:26 smithi134 bash[9858]: audit 2021-01-28T04:17:26.226547+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:26.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:26 smithi134 bash[9858]: cluster 2021-01-28T04:17:26.226718+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-28T04:17:26.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:26 smithi150 bash[9867]: cluster 2021-01-28T04:17:25.053812+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v513: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:26.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:26 smithi150 bash[9867]: audit 2021-01-28T04:17:25.231220+0000 mon.a (mon.0) 897 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:26.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:26 smithi150 bash[9867]: audit 2021-01-28T04:17:26.226547+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:26.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:26 smithi150 bash[9867]: cluster 2021-01-28T04:17:26.226718+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-28T04:17:26.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:26 smithi150 bash[13629]: cluster 2021-01-28T04:17:25.053812+0000 mgr.y (mgr.14138) 564 : cluster [DBG] pgmap v513: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:26.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:26 smithi150 bash[13629]: audit 2021-01-28T04:17:25.231220+0000 mon.a (mon.0) 897 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:26.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:26 smithi150 bash[13629]: audit 2021-01-28T04:17:26.226547+0000 mon.a (mon.0) 898 : audit [INF] from='client.? 172.21.15.150:0/3608484416' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:26.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:26 smithi150 bash[13629]: cluster 2021-01-28T04:17:26.226718+0000 mon.a (mon.0) 899 : cluster [DBG] osdmap e163: 8 total, 8 up, 8 in 2021-01-28T04:17:27.233 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_applications ... ok 2021-01-28T04:17:28.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:28 smithi134 bash[9858]: cluster 2021-01-28T04:17:27.054898+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v516: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:28.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:28 smithi134 bash[9858]: cluster 2021-01-28T04:17:27.228396+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-28T04:17:28.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:28 smithi150 bash[9867]: cluster 2021-01-28T04:17:27.054898+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v516: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:28.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:28 smithi150 bash[9867]: cluster 2021-01-28T04:17:27.228396+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-28T04:17:28.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:28 smithi150 bash[13629]: cluster 2021-01-28T04:17:27.054898+0000 mgr.y (mgr.14138) 565 : cluster [DBG] pgmap v516: 212 pgs: 212 active+clean; 25 KiB data, 157 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:28.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:28 smithi150 bash[13629]: cluster 2021-01-28T04:17:27.228396+0000 mon.a (mon.0) 900 : cluster [DBG] osdmap e164: 8 total, 8 up, 8 in 2021-01-28T04:17:29.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:29 smithi134 bash[9858]: cluster 2021-01-28T04:17:28.237828+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-28T04:17:29.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:29 smithi134 bash[9858]: cluster 2021-01-28T04:17:29.235102+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-28T04:17:29.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:29 smithi150 bash[13629]: cluster 2021-01-28T04:17:28.237828+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-28T04:17:29.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:29 smithi150 bash[13629]: cluster 2021-01-28T04:17:29.235102+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-28T04:17:29.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:29 smithi150 bash[9867]: cluster 2021-01-28T04:17:28.237828+0000 mon.a (mon.0) 901 : cluster [DBG] osdmap e165: 8 total, 8 up, 8 in 2021-01-28T04:17:29.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:29 smithi150 bash[9867]: cluster 2021-01-28T04:17:29.235102+0000 mon.a (mon.0) 902 : cluster [DBG] osdmap e166: 8 total, 8 up, 8 in 2021-01-28T04:17:30.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:30 smithi134 bash[9858]: cluster 2021-01-28T04:17:29.056099+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v519: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:30.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:30 smithi134 bash[9858]: audit 2021-01-28T04:17:29.277823+0000 mon.a (mon.0) 903 : audit [INF] from='client.? 172.21.15.150:0/2099045119' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:30.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:30 smithi134 bash[9858]: audit 2021-01-28T04:17:30.242163+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.150:0/2099045119' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:30.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:30 smithi134 bash[9858]: cluster 2021-01-28T04:17:30.242301+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-28T04:17:30.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:30 smithi150 bash[9867]: cluster 2021-01-28T04:17:29.056099+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v519: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:30.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:30 smithi150 bash[9867]: audit 2021-01-28T04:17:29.277823+0000 mon.a (mon.0) 903 : audit [INF] from='client.? 172.21.15.150:0/2099045119' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:30.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:30 smithi150 bash[9867]: audit 2021-01-28T04:17:30.242163+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.150:0/2099045119' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:30.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:30 smithi150 bash[9867]: cluster 2021-01-28T04:17:30.242301+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-28T04:17:30.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:30 smithi150 bash[13629]: cluster 2021-01-28T04:17:29.056099+0000 mgr.y (mgr.14138) 566 : cluster [DBG] pgmap v519: 212 pgs: 8 creating+peering, 24 unknown, 180 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:30.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:30 smithi150 bash[13629]: audit 2021-01-28T04:17:29.277823+0000 mon.a (mon.0) 903 : audit [INF] from='client.? 172.21.15.150:0/2099045119' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:30.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:30 smithi150 bash[13629]: audit 2021-01-28T04:17:30.242163+0000 mon.a (mon.0) 904 : audit [INF] from='client.? 172.21.15.150:0/2099045119' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:30.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:30 smithi150 bash[13629]: cluster 2021-01-28T04:17:30.242301+0000 mon.a (mon.0) 905 : cluster [DBG] osdmap e167: 8 total, 8 up, 8 in 2021-01-28T04:17:31.243 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_clear_omap ... ok 2021-01-28T04:17:31.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:17:31 smithi150 bash[10146]: debug 2021-01-28T04:17:31.666+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:17:32.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:17:31 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:17:32.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:32 smithi134 bash[9858]: cluster 2021-01-28T04:17:31.056880+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v522: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:32.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:32 smithi134 bash[9858]: cluster 2021-01-28T04:17:31.240577+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-28T04:17:32.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:32 smithi134 bash[9858]: audit 2021-01-28T04:17:31.673248+0000 mgr.y (mgr.14138) 568 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:32.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:32 smithi150 bash[9867]: cluster 2021-01-28T04:17:31.056880+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v522: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:32.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:32 smithi150 bash[9867]: cluster 2021-01-28T04:17:31.240577+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-28T04:17:32.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:32 smithi150 bash[9867]: audit 2021-01-28T04:17:31.673248+0000 mgr.y (mgr.14138) 568 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:32.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:32 smithi150 bash[13629]: cluster 2021-01-28T04:17:31.056880+0000 mgr.y (mgr.14138) 567 : cluster [DBG] pgmap v522: 212 pgs: 8 creating+peering, 21 unknown, 183 active+clean; 25 KiB data, 158 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:32.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:32 smithi150 bash[13629]: cluster 2021-01-28T04:17:31.240577+0000 mon.a (mon.0) 906 : cluster [DBG] osdmap e168: 8 total, 8 up, 8 in 2021-01-28T04:17:32.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:32 smithi150 bash[13629]: audit 2021-01-28T04:17:31.673248+0000 mgr.y (mgr.14138) 568 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:33.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:33 smithi134 bash[9858]: cluster 2021-01-28T04:17:32.258212+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-28T04:17:33.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:33 smithi150 bash[9867]: cluster 2021-01-28T04:17:32.258212+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-28T04:17:33.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:33 smithi150 bash[13629]: cluster 2021-01-28T04:17:32.258212+0000 mon.a (mon.0) 907 : cluster [DBG] osdmap e169: 8 total, 8 up, 8 in 2021-01-28T04:17:34.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:34 smithi134 bash[9858]: cluster 2021-01-28T04:17:33.058268+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v525: 212 pgs: 18 creating+peering, 14 unknown, 180 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:17:34.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:34 smithi134 bash[9858]: cluster 2021-01-28T04:17:33.255420+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-28T04:17:34.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:34 smithi134 bash[9858]: audit 2021-01-28T04:17:33.291980+0000 mon.a (mon.0) 909 : audit [INF] from='client.? 172.21.15.150:0/1695385247' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:34.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:34 smithi150 bash[13629]: cluster 2021-01-28T04:17:33.058268+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v525: 212 pgs: 18 creating+peering, 14 unknown, 180 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:17:34.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:34 smithi150 bash[13629]: cluster 2021-01-28T04:17:33.255420+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-28T04:17:34.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:34 smithi150 bash[13629]: audit 2021-01-28T04:17:33.291980+0000 mon.a (mon.0) 909 : audit [INF] from='client.? 172.21.15.150:0/1695385247' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:34.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:34 smithi150 bash[9867]: cluster 2021-01-28T04:17:33.058268+0000 mgr.y (mgr.14138) 569 : cluster [DBG] pgmap v525: 212 pgs: 18 creating+peering, 14 unknown, 180 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:17:34.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:34 smithi150 bash[9867]: cluster 2021-01-28T04:17:33.255420+0000 mon.a (mon.0) 908 : cluster [DBG] osdmap e170: 8 total, 8 up, 8 in 2021-01-28T04:17:34.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:34 smithi150 bash[9867]: audit 2021-01-28T04:17:33.291980+0000 mon.a (mon.0) 909 : audit [INF] from='client.? 172.21.15.150:0/1695385247' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:35.282 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_cmpext ... ok 2021-01-28T04:17:35.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:35 smithi134 bash[9858]: audit 2021-01-28T04:17:34.267963+0000 mon.a (mon.0) 910 : audit [INF] from='client.? 172.21.15.150:0/1695385247' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:35.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:35 smithi134 bash[9858]: cluster 2021-01-28T04:17:34.268101+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-28T04:17:35.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:35 smithi150 bash[9867]: audit 2021-01-28T04:17:34.267963+0000 mon.a (mon.0) 910 : audit [INF] from='client.? 172.21.15.150:0/1695385247' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:35.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:35 smithi150 bash[9867]: cluster 2021-01-28T04:17:34.268101+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-28T04:17:35.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:35 smithi150 bash[13629]: audit 2021-01-28T04:17:34.267963+0000 mon.a (mon.0) 910 : audit [INF] from='client.? 172.21.15.150:0/1695385247' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:35.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:35 smithi150 bash[13629]: cluster 2021-01-28T04:17:34.268101+0000 mon.a (mon.0) 911 : cluster [DBG] osdmap e171: 8 total, 8 up, 8 in 2021-01-28T04:17:36.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:36 smithi134 bash[9858]: cluster 2021-01-28T04:17:35.059369+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v528: 212 pgs: 18 creating+peering, 4 unknown, 190 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:17:36.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:36 smithi134 bash[9858]: cluster 2021-01-28T04:17:35.277020+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-28T04:17:36.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:36 smithi150 bash[9867]: cluster 2021-01-28T04:17:35.059369+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v528: 212 pgs: 18 creating+peering, 4 unknown, 190 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:17:36.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:36 smithi150 bash[9867]: cluster 2021-01-28T04:17:35.277020+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-28T04:17:36.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:36 smithi150 bash[13629]: cluster 2021-01-28T04:17:35.059369+0000 mgr.y (mgr.14138) 570 : cluster [DBG] pgmap v528: 212 pgs: 18 creating+peering, 4 unknown, 190 active+clean; 25 KiB data, 159 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:17:36.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:36 smithi150 bash[13629]: cluster 2021-01-28T04:17:35.277020+0000 mon.a (mon.0) 912 : cluster [DBG] osdmap e172: 8 total, 8 up, 8 in 2021-01-28T04:17:37.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:37 smithi134 bash[9858]: cluster 2021-01-28T04:17:36.315955+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-28T04:17:37.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:37 smithi150 bash[9867]: cluster 2021-01-28T04:17:36.315955+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-28T04:17:37.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:37 smithi150 bash[13629]: cluster 2021-01-28T04:17:36.315955+0000 mon.a (mon.0) 913 : cluster [DBG] osdmap e173: 8 total, 8 up, 8 in 2021-01-28T04:17:38.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:38 smithi134 bash[9858]: cluster 2021-01-28T04:17:37.060420+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v531: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:38.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:38 smithi134 bash[9858]: cluster 2021-01-28T04:17:37.319016+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-28T04:17:38.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:38 smithi134 bash[9858]: audit 2021-01-28T04:17:37.357801+0000 mon.a (mon.0) 915 : audit [INF] from='client.? 172.21.15.150:0/1318966617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:38.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:38 smithi150 bash[9867]: cluster 2021-01-28T04:17:37.060420+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v531: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:38.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:38 smithi150 bash[9867]: cluster 2021-01-28T04:17:37.319016+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-28T04:17:38.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:38 smithi150 bash[9867]: audit 2021-01-28T04:17:37.357801+0000 mon.a (mon.0) 915 : audit [INF] from='client.? 172.21.15.150:0/1318966617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:38.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:38 smithi150 bash[13629]: cluster 2021-01-28T04:17:37.060420+0000 mgr.y (mgr.14138) 571 : cluster [DBG] pgmap v531: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 164 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:38.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:38 smithi150 bash[13629]: cluster 2021-01-28T04:17:37.319016+0000 mon.a (mon.0) 914 : cluster [DBG] osdmap e174: 8 total, 8 up, 8 in 2021-01-28T04:17:38.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:38 smithi150 bash[13629]: audit 2021-01-28T04:17:37.357801+0000 mon.a (mon.0) 915 : audit [INF] from='client.? 172.21.15.150:0/1318966617' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:39.362 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_cmpext_op ... ok 2021-01-28T04:17:39.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:39 smithi134 bash[9858]: audit 2021-01-28T04:17:38.343218+0000 mon.a (mon.0) 916 : audit [INF] from='client.? 172.21.15.150:0/1318966617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:39.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:39 smithi134 bash[9858]: cluster 2021-01-28T04:17:38.343351+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-28T04:17:39.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:39 smithi150 bash[9867]: audit 2021-01-28T04:17:38.343218+0000 mon.a (mon.0) 916 : audit [INF] from='client.? 172.21.15.150:0/1318966617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:39.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:39 smithi150 bash[9867]: cluster 2021-01-28T04:17:38.343351+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-28T04:17:39.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:39 smithi150 bash[13629]: audit 2021-01-28T04:17:38.343218+0000 mon.a (mon.0) 916 : audit [INF] from='client.? 172.21.15.150:0/1318966617' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:39.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:39 smithi150 bash[13629]: cluster 2021-01-28T04:17:38.343351+0000 mon.a (mon.0) 917 : cluster [DBG] osdmap e175: 8 total, 8 up, 8 in 2021-01-28T04:17:40.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:40 smithi134 bash[9858]: cluster 2021-01-28T04:17:39.061807+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v534: 212 pgs: 8 creating+peering, 3 unknown, 201 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-28T04:17:40.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:40 smithi134 bash[9858]: cluster 2021-01-28T04:17:39.336825+0000 mon.a (mon.0) 918 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:17:40.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:40 smithi134 bash[9858]: cluster 2021-01-28T04:17:39.353281+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-28T04:17:40.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:40 smithi150 bash[9867]: cluster 2021-01-28T04:17:39.061807+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v534: 212 pgs: 8 creating+peering, 3 unknown, 201 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-28T04:17:40.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:40 smithi150 bash[9867]: cluster 2021-01-28T04:17:39.336825+0000 mon.a (mon.0) 918 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:17:40.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:40 smithi150 bash[9867]: cluster 2021-01-28T04:17:39.353281+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-28T04:17:40.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:40 smithi150 bash[13629]: cluster 2021-01-28T04:17:39.061807+0000 mgr.y (mgr.14138) 572 : cluster [DBG] pgmap v534: 212 pgs: 8 creating+peering, 3 unknown, 201 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 2 op/s 2021-01-28T04:17:40.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:40 smithi150 bash[13629]: cluster 2021-01-28T04:17:39.336825+0000 mon.a (mon.0) 918 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:17:40.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:40 smithi150 bash[13629]: cluster 2021-01-28T04:17:39.353281+0000 mon.a (mon.0) 919 : cluster [DBG] osdmap e176: 8 total, 8 up, 8 in 2021-01-28T04:17:41.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:41 smithi134 bash[9858]: cluster 2021-01-28T04:17:40.366234+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-28T04:17:41.684 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:41 smithi150 bash[9867]: cluster 2021-01-28T04:17:40.366234+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-28T04:17:41.684 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:41 smithi150 bash[13629]: cluster 2021-01-28T04:17:40.366234+0000 mon.a (mon.0) 920 : cluster [DBG] osdmap e177: 8 total, 8 up, 8 in 2021-01-28T04:17:41.975 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:17:41 smithi150 bash[10146]: debug 2021-01-28T04:17:41.682+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:17:42.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:17:41 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:17:42.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[9867]: cluster 2021-01-28T04:17:41.062673+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v537: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:42.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[9867]: cluster 2021-01-28T04:17:41.359550+0000 mon.a (mon.0) 921 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:17:42.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[9867]: cluster 2021-01-28T04:17:41.359623+0000 mon.a (mon.0) 922 : cluster [INF] Cluster is now healthy 2021-01-28T04:17:42.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[9867]: cluster 2021-01-28T04:17:41.384345+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-28T04:17:42.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[9867]: audit 2021-01-28T04:17:41.683577+0000 mgr.y (mgr.14138) 574 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:42.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[13629]: cluster 2021-01-28T04:17:41.062673+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v537: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:42.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[13629]: cluster 2021-01-28T04:17:41.359550+0000 mon.a (mon.0) 921 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:17:42.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[13629]: cluster 2021-01-28T04:17:41.359623+0000 mon.a (mon.0) 922 : cluster [INF] Cluster is now healthy 2021-01-28T04:17:42.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[13629]: cluster 2021-01-28T04:17:41.384345+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-28T04:17:42.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:42 smithi150 bash[13629]: audit 2021-01-28T04:17:41.683577+0000 mgr.y (mgr.14138) 574 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:42.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:42 smithi134 bash[9858]: cluster 2021-01-28T04:17:41.062673+0000 mgr.y (mgr.14138) 573 : cluster [DBG] pgmap v537: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 165 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:42.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:42 smithi134 bash[9858]: cluster 2021-01-28T04:17:41.359550+0000 mon.a (mon.0) 921 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:17:42.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:42 smithi134 bash[9858]: cluster 2021-01-28T04:17:41.359623+0000 mon.a (mon.0) 922 : cluster [INF] Cluster is now healthy 2021-01-28T04:17:42.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:42 smithi134 bash[9858]: cluster 2021-01-28T04:17:41.384345+0000 mon.a (mon.0) 923 : cluster [DBG] osdmap e178: 8 total, 8 up, 8 in 2021-01-28T04:17:42.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:42 smithi134 bash[9858]: audit 2021-01-28T04:17:41.683577+0000 mgr.y (mgr.14138) 574 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:43.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:43 smithi150 bash[9867]: cluster 2021-01-28T04:17:42.381700+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-28T04:17:43.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:43 smithi150 bash[9867]: audit 2021-01-28T04:17:42.385629+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.150:0/2015368013' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:43.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:43 smithi150 bash[9867]: audit 2021-01-28T04:17:42.386480+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:43.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:43 smithi150 bash[13629]: cluster 2021-01-28T04:17:42.381700+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-28T04:17:43.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:43 smithi150 bash[13629]: audit 2021-01-28T04:17:42.385629+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.150:0/2015368013' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:43.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:43 smithi150 bash[13629]: audit 2021-01-28T04:17:42.386480+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:43.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:43 smithi134 bash[9858]: cluster 2021-01-28T04:17:42.381700+0000 mon.a (mon.0) 924 : cluster [DBG] osdmap e179: 8 total, 8 up, 8 in 2021-01-28T04:17:43.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:43 smithi134 bash[9858]: audit 2021-01-28T04:17:42.385629+0000 mon.c (mon.1) 44 : audit [INF] from='client.? 172.21.15.150:0/2015368013' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:43.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:43 smithi134 bash[9858]: audit 2021-01-28T04:17:42.386480+0000 mon.a (mon.0) 925 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:44.414 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_create_snap ... ok 2021-01-28T04:17:44.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:44 smithi150 bash[9867]: cluster 2021-01-28T04:17:43.063952+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v540: 212 pgs: 14 unknown, 198 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:17:44.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:44 smithi150 bash[9867]: audit 2021-01-28T04:17:43.385900+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:44.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:44 smithi150 bash[9867]: cluster 2021-01-28T04:17:43.386290+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-28T04:17:44.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:44 smithi150 bash[13629]: cluster 2021-01-28T04:17:43.063952+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v540: 212 pgs: 14 unknown, 198 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:17:44.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:44 smithi150 bash[13629]: audit 2021-01-28T04:17:43.385900+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:44.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:44 smithi150 bash[13629]: cluster 2021-01-28T04:17:43.386290+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-28T04:17:44.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:44 smithi134 bash[9858]: cluster 2021-01-28T04:17:43.063952+0000 mgr.y (mgr.14138) 575 : cluster [DBG] pgmap v540: 212 pgs: 14 unknown, 198 active+clean; 25 KiB data, 166 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2021-01-28T04:17:44.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:44 smithi134 bash[9858]: audit 2021-01-28T04:17:43.385900+0000 mon.a (mon.0) 926 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:44.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:44 smithi134 bash[9858]: cluster 2021-01-28T04:17:43.386290+0000 mon.a (mon.0) 927 : cluster [DBG] osdmap e180: 8 total, 8 up, 8 in 2021-01-28T04:17:45.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:45 smithi150 bash[9867]: cluster 2021-01-28T04:17:44.401576+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-28T04:17:45.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:45 smithi150 bash[13629]: cluster 2021-01-28T04:17:44.401576+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-28T04:17:45.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:45 smithi134 bash[9858]: cluster 2021-01-28T04:17:44.401576+0000 mon.a (mon.0) 928 : cluster [DBG] osdmap e181: 8 total, 8 up, 8 in 2021-01-28T04:17:46.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:46 smithi150 bash[9867]: cluster 2021-01-28T04:17:45.064944+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v543: 180 pgs: 180 active+clean; 25 KiB data, 167 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:46.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:46 smithi150 bash[9867]: cluster 2021-01-28T04:17:45.427176+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-28T04:17:46.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:46 smithi150 bash[13629]: cluster 2021-01-28T04:17:45.064944+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v543: 180 pgs: 180 active+clean; 25 KiB data, 167 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:46.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:46 smithi150 bash[13629]: cluster 2021-01-28T04:17:45.427176+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-28T04:17:46.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:46 smithi134 bash[9858]: cluster 2021-01-28T04:17:45.064944+0000 mgr.y (mgr.14138) 576 : cluster [DBG] pgmap v543: 180 pgs: 180 active+clean; 25 KiB data, 167 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:46.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:46 smithi134 bash[9858]: cluster 2021-01-28T04:17:45.427176+0000 mon.a (mon.0) 929 : cluster [DBG] osdmap e182: 8 total, 8 up, 8 in 2021-01-28T04:17:47.725 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:47 smithi150 bash[13629]: cluster 2021-01-28T04:17:46.437818+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-28T04:17:47.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:47 smithi150 bash[13629]: audit 2021-01-28T04:17:46.470305+0000 mon.a (mon.0) 931 : audit [INF] from='client.? 172.21.15.150:0/4218484881' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:47.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:47 smithi150 bash[9867]: cluster 2021-01-28T04:17:46.437818+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-28T04:17:47.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:47 smithi150 bash[9867]: audit 2021-01-28T04:17:46.470305+0000 mon.a (mon.0) 931 : audit [INF] from='client.? 172.21.15.150:0/4218484881' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:47.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:47 smithi134 bash[9858]: cluster 2021-01-28T04:17:46.437818+0000 mon.a (mon.0) 930 : cluster [DBG] osdmap e183: 8 total, 8 up, 8 in 2021-01-28T04:17:47.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:47 smithi134 bash[9858]: audit 2021-01-28T04:17:46.470305+0000 mon.a (mon.0) 931 : audit [INF] from='client.? 172.21.15.150:0/4218484881' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:48.447 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_execute ... ok 2021-01-28T04:17:48.725 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:48 smithi150 bash[9867]: cluster 2021-01-28T04:17:47.066051+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v546: 212 pgs: 27 unknown, 185 active+clean; 25 KiB data, 167 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:48.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:48 smithi150 bash[9867]: audit 2021-01-28T04:17:47.445751+0000 mon.a (mon.0) 932 : audit [INF] from='client.? 172.21.15.150:0/4218484881' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:48.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:48 smithi150 bash[9867]: cluster 2021-01-28T04:17:47.446034+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-28T04:17:48.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:48 smithi150 bash[9867]: cluster 2021-01-28T04:17:48.442547+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-28T04:17:48.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:48 smithi150 bash[13629]: cluster 2021-01-28T04:17:47.066051+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v546: 212 pgs: 27 unknown, 185 active+clean; 25 KiB data, 167 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:48.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:48 smithi150 bash[13629]: audit 2021-01-28T04:17:47.445751+0000 mon.a (mon.0) 932 : audit [INF] from='client.? 172.21.15.150:0/4218484881' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:48.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:48 smithi150 bash[13629]: cluster 2021-01-28T04:17:47.446034+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-28T04:17:48.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:48 smithi150 bash[13629]: cluster 2021-01-28T04:17:48.442547+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-28T04:17:48.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:48 smithi134 bash[9858]: cluster 2021-01-28T04:17:47.066051+0000 mgr.y (mgr.14138) 577 : cluster [DBG] pgmap v546: 212 pgs: 27 unknown, 185 active+clean; 25 KiB data, 167 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:48.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:48 smithi134 bash[9858]: audit 2021-01-28T04:17:47.445751+0000 mon.a (mon.0) 932 : audit [INF] from='client.? 172.21.15.150:0/4218484881' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:48.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:48 smithi134 bash[9858]: cluster 2021-01-28T04:17:47.446034+0000 mon.a (mon.0) 933 : cluster [DBG] osdmap e184: 8 total, 8 up, 8 in 2021-01-28T04:17:48.889 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:48 smithi134 bash[9858]: cluster 2021-01-28T04:17:48.442547+0000 mon.a (mon.0) 934 : cluster [DBG] osdmap e185: 8 total, 8 up, 8 in 2021-01-28T04:17:50.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:50 smithi134 bash[9858]: cluster 2021-01-28T04:17:49.067008+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v549: 180 pgs: 180 active+clean; 25 KiB data, 172 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:50.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:50 smithi134 bash[9858]: cluster 2021-01-28T04:17:49.467335+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-28T04:17:50.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:50 smithi150 bash[9867]: cluster 2021-01-28T04:17:49.067008+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v549: 180 pgs: 180 active+clean; 25 KiB data, 172 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:50.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:50 smithi150 bash[9867]: cluster 2021-01-28T04:17:49.467335+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-28T04:17:50.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:50 smithi150 bash[13629]: cluster 2021-01-28T04:17:49.067008+0000 mgr.y (mgr.14138) 578 : cluster [DBG] pgmap v549: 180 pgs: 180 active+clean; 25 KiB data, 172 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:50.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:50 smithi150 bash[13629]: cluster 2021-01-28T04:17:49.467335+0000 mon.a (mon.0) 935 : cluster [DBG] osdmap e186: 8 total, 8 up, 8 in 2021-01-28T04:17:51.887 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:17:51 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:17:51.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:51 smithi134 bash[9858]: cluster 2021-01-28T04:17:50.476506+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-28T04:17:51.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:51 smithi134 bash[9858]: audit 2021-01-28T04:17:50.511236+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.150:0/1055517629' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:51.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:51 smithi134 bash[9858]: audit 2021-01-28T04:17:50.511618+0000 mon.a (mon.0) 937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:51.976 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:17:51 smithi150 bash[10146]: debug 2021-01-28T04:17:51.686+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:17:51.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:51 smithi150 bash[9867]: cluster 2021-01-28T04:17:50.476506+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-28T04:17:51.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:51 smithi150 bash[9867]: audit 2021-01-28T04:17:50.511236+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.150:0/1055517629' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:51.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:51 smithi150 bash[9867]: audit 2021-01-28T04:17:50.511618+0000 mon.a (mon.0) 937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:51.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:51 smithi150 bash[13629]: cluster 2021-01-28T04:17:50.476506+0000 mon.a (mon.0) 936 : cluster [DBG] osdmap e187: 8 total, 8 up, 8 in 2021-01-28T04:17:51.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:51 smithi150 bash[13629]: audit 2021-01-28T04:17:50.511236+0000 mon.c (mon.1) 45 : audit [INF] from='client.? 172.21.15.150:0/1055517629' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:51.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:51 smithi150 bash[13629]: audit 2021-01-28T04:17:50.511618+0000 mon.a (mon.0) 937 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:52.502 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_execute_op ... ok 2021-01-28T04:17:52.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:52 smithi134 bash[9858]: cluster 2021-01-28T04:17:51.067794+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v552: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:52.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:52 smithi134 bash[9858]: audit 2021-01-28T04:17:51.494716+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:52.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:52 smithi134 bash[9858]: cluster 2021-01-28T04:17:51.494958+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-28T04:17:52.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:52 smithi134 bash[9858]: audit 2021-01-28T04:17:51.690089+0000 mgr.y (mgr.14138) 580 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:52.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:52 smithi150 bash[9867]: cluster 2021-01-28T04:17:51.067794+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v552: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:52.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:52 smithi150 bash[9867]: audit 2021-01-28T04:17:51.494716+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:52.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:52 smithi150 bash[9867]: cluster 2021-01-28T04:17:51.494958+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-28T04:17:52.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:52 smithi150 bash[9867]: audit 2021-01-28T04:17:51.690089+0000 mgr.y (mgr.14138) 580 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:52.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:52 smithi150 bash[13629]: cluster 2021-01-28T04:17:51.067794+0000 mgr.y (mgr.14138) 579 : cluster [DBG] pgmap v552: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 173 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:17:52.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:52 smithi150 bash[13629]: audit 2021-01-28T04:17:51.494716+0000 mon.a (mon.0) 938 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:52.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:52 smithi150 bash[13629]: cluster 2021-01-28T04:17:51.494958+0000 mon.a (mon.0) 939 : cluster [DBG] osdmap e188: 8 total, 8 up, 8 in 2021-01-28T04:17:52.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:52 smithi150 bash[13629]: audit 2021-01-28T04:17:51.690089+0000 mgr.y (mgr.14138) 580 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:17:53.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:53 smithi134 bash[9858]: cluster 2021-01-28T04:17:52.497021+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-28T04:17:53.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:53 smithi150 bash[9867]: cluster 2021-01-28T04:17:52.497021+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-28T04:17:53.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:53 smithi150 bash[13629]: cluster 2021-01-28T04:17:52.497021+0000 mon.a (mon.0) 940 : cluster [DBG] osdmap e189: 8 total, 8 up, 8 in 2021-01-28T04:17:54.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:54 smithi134 bash[9858]: cluster 2021-01-28T04:17:53.068906+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v555: 180 pgs: 180 active+clean; 25 KiB data, 174 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:54.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:54 smithi134 bash[9858]: cluster 2021-01-28T04:17:53.519808+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-28T04:17:54.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:54 smithi134 bash[9858]: audit 2021-01-28T04:17:53.522173+0000 mon.a (mon.0) 942 : audit [INF] from='client.? 172.21.15.150:0/2171542517' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:54.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:54 smithi150 bash[9867]: cluster 2021-01-28T04:17:53.068906+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v555: 180 pgs: 180 active+clean; 25 KiB data, 174 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:54.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:54 smithi150 bash[9867]: cluster 2021-01-28T04:17:53.519808+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-28T04:17:54.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:54 smithi150 bash[9867]: audit 2021-01-28T04:17:53.522173+0000 mon.a (mon.0) 942 : audit [INF] from='client.? 172.21.15.150:0/2171542517' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:54.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:54 smithi150 bash[13629]: cluster 2021-01-28T04:17:53.068906+0000 mgr.y (mgr.14138) 581 : cluster [DBG] pgmap v555: 180 pgs: 180 active+clean; 25 KiB data, 174 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:54.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:54 smithi150 bash[13629]: cluster 2021-01-28T04:17:53.519808+0000 mon.a (mon.0) 941 : cluster [DBG] osdmap e190: 8 total, 8 up, 8 in 2021-01-28T04:17:54.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:54 smithi150 bash[13629]: audit 2021-01-28T04:17:53.522173+0000 mon.a (mon.0) 942 : audit [INF] from='client.? 172.21.15.150:0/2171542517' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:55.534 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_get_last_version ... ok 2021-01-28T04:17:55.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:55 smithi134 bash[9858]: audit 2021-01-28T04:17:54.526421+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.150:0/2171542517' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:55.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:55 smithi134 bash[9858]: cluster 2021-01-28T04:17:54.527033+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-28T04:17:55.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:55 smithi134 bash[9858]: cluster 2021-01-28T04:17:55.526905+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-28T04:17:55.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:55 smithi150 bash[13629]: audit 2021-01-28T04:17:54.526421+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.150:0/2171542517' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:55.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:55 smithi150 bash[13629]: cluster 2021-01-28T04:17:54.527033+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-28T04:17:55.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:55 smithi150 bash[13629]: cluster 2021-01-28T04:17:55.526905+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-28T04:17:55.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:55 smithi150 bash[9867]: audit 2021-01-28T04:17:54.526421+0000 mon.a (mon.0) 943 : audit [INF] from='client.? 172.21.15.150:0/2171542517' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:55.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:55 smithi150 bash[9867]: cluster 2021-01-28T04:17:54.527033+0000 mon.a (mon.0) 944 : cluster [DBG] osdmap e191: 8 total, 8 up, 8 in 2021-01-28T04:17:55.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:55 smithi150 bash[9867]: cluster 2021-01-28T04:17:55.526905+0000 mon.a (mon.0) 945 : cluster [DBG] osdmap e192: 8 total, 8 up, 8 in 2021-01-28T04:17:56.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:56 smithi134 bash[9858]: cluster 2021-01-28T04:17:55.069935+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v558: 212 pgs: 7 creating+peering, 24 unknown, 181 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:56.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:56 smithi150 bash[9867]: cluster 2021-01-28T04:17:55.069935+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v558: 212 pgs: 7 creating+peering, 24 unknown, 181 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:56.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:56 smithi150 bash[13629]: cluster 2021-01-28T04:17:55.069935+0000 mgr.y (mgr.14138) 582 : cluster [DBG] pgmap v558: 212 pgs: 7 creating+peering, 24 unknown, 181 active+clean; 25 KiB data, 178 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:57.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:57 smithi134 bash[9858]: cluster 2021-01-28T04:17:56.560909+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-28T04:17:57.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:57 smithi134 bash[9858]: cluster 2021-01-28T04:17:57.560542+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-28T04:17:57.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:57 smithi150 bash[9867]: cluster 2021-01-28T04:17:56.560909+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-28T04:17:57.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:57 smithi150 bash[9867]: cluster 2021-01-28T04:17:57.560542+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-28T04:17:57.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:57 smithi150 bash[13629]: cluster 2021-01-28T04:17:56.560909+0000 mon.a (mon.0) 946 : cluster [DBG] osdmap e193: 8 total, 8 up, 8 in 2021-01-28T04:17:57.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:57 smithi150 bash[13629]: cluster 2021-01-28T04:17:57.560542+0000 mon.a (mon.0) 947 : cluster [DBG] osdmap e194: 8 total, 8 up, 8 in 2021-01-28T04:17:58.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:58 smithi134 bash[9858]: cluster 2021-01-28T04:17:57.070995+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v561: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:58.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:58 smithi134 bash[9858]: audit 2021-01-28T04:17:57.594234+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.150:0/1691682264' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:58.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:58 smithi134 bash[9858]: audit 2021-01-28T04:17:57.594605+0000 mon.a (mon.0) 948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:58.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:58 smithi150 bash[9867]: cluster 2021-01-28T04:17:57.070995+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v561: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:58.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:58 smithi150 bash[9867]: audit 2021-01-28T04:17:57.594234+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.150:0/1691682264' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:58.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:58 smithi150 bash[9867]: audit 2021-01-28T04:17:57.594605+0000 mon.a (mon.0) 948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:58.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:58 smithi150 bash[13629]: cluster 2021-01-28T04:17:57.070995+0000 mgr.y (mgr.14138) 583 : cluster [DBG] pgmap v561: 212 pgs: 3 creating+peering, 29 unknown, 180 active+clean; 25 KiB data, 179 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:17:58.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:58 smithi150 bash[13629]: audit 2021-01-28T04:17:57.594234+0000 mon.c (mon.1) 46 : audit [INF] from='client.? 172.21.15.150:0/1691682264' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:58.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:58 smithi150 bash[13629]: audit 2021-01-28T04:17:57.594605+0000 mon.a (mon.0) 948 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:17:59.597 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_get_omap_keys ... ok 2021-01-28T04:17:59.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:59 smithi134 bash[9858]: audit 2021-01-28T04:17:58.588921+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:59.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:17:59 smithi134 bash[9858]: cluster 2021-01-28T04:17:58.589077+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-28T04:17:59.980 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:59 smithi150 bash[9867]: audit 2021-01-28T04:17:58.588921+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:59.981 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:17:59 smithi150 bash[9867]: cluster 2021-01-28T04:17:58.589077+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-28T04:17:59.981 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:59 smithi150 bash[13629]: audit 2021-01-28T04:17:58.588921+0000 mon.a (mon.0) 949 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:17:59.982 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:17:59 smithi150 bash[13629]: cluster 2021-01-28T04:17:58.589077+0000 mon.a (mon.0) 950 : cluster [DBG] osdmap e195: 8 total, 8 up, 8 in 2021-01-28T04:18:00.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:00 smithi134 bash[9858]: cluster 2021-01-28T04:17:59.072106+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v564: 212 pgs: 6 creating+peering, 6 unknown, 200 active+clean; 25 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:00.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:00 smithi134 bash[9858]: cluster 2021-01-28T04:17:59.594194+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-28T04:18:00.975 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:00 smithi150 bash[9867]: cluster 2021-01-28T04:17:59.072106+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v564: 212 pgs: 6 creating+peering, 6 unknown, 200 active+clean; 25 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:00.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:00 smithi150 bash[9867]: cluster 2021-01-28T04:17:59.594194+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-28T04:18:00.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:00 smithi150 bash[13629]: cluster 2021-01-28T04:17:59.072106+0000 mgr.y (mgr.14138) 584 : cluster [DBG] pgmap v564: 212 pgs: 6 creating+peering, 6 unknown, 200 active+clean; 25 KiB data, 180 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:00.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:00 smithi150 bash[13629]: cluster 2021-01-28T04:17:59.594194+0000 mon.a (mon.0) 951 : cluster [DBG] osdmap e196: 8 total, 8 up, 8 in 2021-01-28T04:18:01.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:01 smithi150 bash[13629]: cluster 2021-01-28T04:18:00.624257+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-28T04:18:01.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:01 smithi150 bash[9867]: cluster 2021-01-28T04:18:00.624257+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-28T04:18:01.976 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:18:01 smithi150 bash[10146]: debug 2021-01-28T04:18:01.697+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:18:02.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:01 smithi134 bash[9858]: cluster 2021-01-28T04:18:00.624257+0000 mon.a (mon.0) 952 : cluster [DBG] osdmap e197: 8 total, 8 up, 8 in 2021-01-28T04:18:02.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:18:01 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:18:02.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[9867]: cluster 2021-01-28T04:18:01.072907+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v567: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 180 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:02.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[9867]: cluster 2021-01-28T04:18:01.630968+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-28T04:18:02.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[9867]: audit 2021-01-28T04:18:01.673644+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.150:0/2458702663' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:02.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[9867]: audit 2021-01-28T04:18:01.674105+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:02.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[9867]: audit 2021-01-28T04:18:01.702033+0000 mgr.y (mgr.14138) 586 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:02.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[13629]: cluster 2021-01-28T04:18:01.072907+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v567: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 180 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:02.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[13629]: cluster 2021-01-28T04:18:01.630968+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-28T04:18:02.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[13629]: audit 2021-01-28T04:18:01.673644+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.150:0/2458702663' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:02.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[13629]: audit 2021-01-28T04:18:01.674105+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:02.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:02 smithi150 bash[13629]: audit 2021-01-28T04:18:01.702033+0000 mgr.y (mgr.14138) 586 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:03.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:02 smithi134 bash[9858]: cluster 2021-01-28T04:18:01.072907+0000 mgr.y (mgr.14138) 585 : cluster [DBG] pgmap v567: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 180 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:03.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:02 smithi134 bash[9858]: cluster 2021-01-28T04:18:01.630968+0000 mon.a (mon.0) 953 : cluster [DBG] osdmap e198: 8 total, 8 up, 8 in 2021-01-28T04:18:03.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:02 smithi134 bash[9858]: audit 2021-01-28T04:18:01.673644+0000 mon.c (mon.1) 47 : audit [INF] from='client.? 172.21.15.150:0/2458702663' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:03.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:02 smithi134 bash[9858]: audit 2021-01-28T04:18:01.674105+0000 mon.a (mon.0) 954 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:03.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:02 smithi134 bash[9858]: audit 2021-01-28T04:18:01.702033+0000 mgr.y (mgr.14138) 586 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:03.664 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_get_omap_vals_by_keys ... ok 2021-01-28T04:18:03.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:03 smithi150 bash[9867]: audit 2021-01-28T04:18:02.656116+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:03.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:03 smithi150 bash[9867]: cluster 2021-01-28T04:18:02.656231+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-28T04:18:03.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:03 smithi150 bash[13629]: audit 2021-01-28T04:18:02.656116+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:03.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:03 smithi150 bash[13629]: cluster 2021-01-28T04:18:02.656231+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-28T04:18:04.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:03 smithi134 bash[9858]: audit 2021-01-28T04:18:02.656116+0000 mon.a (mon.0) 955 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:04.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:03 smithi134 bash[9858]: cluster 2021-01-28T04:18:02.656231+0000 mon.a (mon.0) 956 : cluster [DBG] osdmap e199: 8 total, 8 up, 8 in 2021-01-28T04:18:04.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:04 smithi150 bash[9867]: cluster 2021-01-28T04:18:03.074195+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v570: 212 pgs: 11 unknown, 201 active+clean; 25 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:04.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:04 smithi150 bash[9867]: cluster 2021-01-28T04:18:03.661022+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-28T04:18:04.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:04 smithi150 bash[13629]: cluster 2021-01-28T04:18:03.074195+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v570: 212 pgs: 11 unknown, 201 active+clean; 25 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:04.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:04 smithi150 bash[13629]: cluster 2021-01-28T04:18:03.661022+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-28T04:18:05.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:04 smithi134 bash[9858]: cluster 2021-01-28T04:18:03.074195+0000 mgr.y (mgr.14138) 587 : cluster [DBG] pgmap v570: 212 pgs: 11 unknown, 201 active+clean; 25 KiB data, 190 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:05.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:04 smithi134 bash[9858]: cluster 2021-01-28T04:18:03.661022+0000 mon.a (mon.0) 957 : cluster [DBG] osdmap e200: 8 total, 8 up, 8 in 2021-01-28T04:18:05.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:05 smithi150 bash[9867]: cluster 2021-01-28T04:18:04.681831+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-28T04:18:05.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:05 smithi150 bash[9867]: audit 2021-01-28T04:18:04.686431+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.150:0/224708154' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:05.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:05 smithi150 bash[9867]: audit 2021-01-28T04:18:04.687065+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:05.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:05 smithi150 bash[13629]: cluster 2021-01-28T04:18:04.681831+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-28T04:18:05.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:05 smithi150 bash[13629]: audit 2021-01-28T04:18:04.686431+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.150:0/224708154' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:05.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:05 smithi150 bash[13629]: audit 2021-01-28T04:18:04.687065+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:06.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:05 smithi134 bash[9858]: cluster 2021-01-28T04:18:04.681831+0000 mon.a (mon.0) 958 : cluster [DBG] osdmap e201: 8 total, 8 up, 8 in 2021-01-28T04:18:06.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:05 smithi134 bash[9858]: audit 2021-01-28T04:18:04.686431+0000 mon.c (mon.1) 48 : audit [INF] from='client.? 172.21.15.150:0/224708154' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:06.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:05 smithi134 bash[9858]: audit 2021-01-28T04:18:04.687065+0000 mon.a (mon.0) 959 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:06.697 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_get_pool_id ... ok 2021-01-28T04:18:06.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:06 smithi150 bash[13629]: cluster 2021-01-28T04:18:05.075250+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v573: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:06.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:06 smithi150 bash[13629]: audit 2021-01-28T04:18:05.689240+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:06.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:06 smithi150 bash[13629]: cluster 2021-01-28T04:18:05.690510+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-28T04:18:06.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:06 smithi150 bash[13629]: cluster 2021-01-28T04:18:06.689404+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-28T04:18:06.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:06 smithi150 bash[9867]: cluster 2021-01-28T04:18:05.075250+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v573: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:06.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:06 smithi150 bash[9867]: audit 2021-01-28T04:18:05.689240+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:06.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:06 smithi150 bash[9867]: cluster 2021-01-28T04:18:05.690510+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-28T04:18:06.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:06 smithi150 bash[9867]: cluster 2021-01-28T04:18:06.689404+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-28T04:18:07.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:06 smithi134 bash[9858]: cluster 2021-01-28T04:18:05.075250+0000 mgr.y (mgr.14138) 588 : cluster [DBG] pgmap v573: 212 pgs: 5 creating+peering, 27 unknown, 180 active+clean; 25 KiB data, 194 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:07.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:06 smithi134 bash[9858]: audit 2021-01-28T04:18:05.689240+0000 mon.a (mon.0) 960 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:07.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:06 smithi134 bash[9858]: cluster 2021-01-28T04:18:05.690510+0000 mon.a (mon.0) 961 : cluster [DBG] osdmap e202: 8 total, 8 up, 8 in 2021-01-28T04:18:07.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:06 smithi134 bash[9858]: cluster 2021-01-28T04:18:06.689404+0000 mon.a (mon.0) 962 : cluster [DBG] osdmap e203: 8 total, 8 up, 8 in 2021-01-28T04:18:09.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:08 smithi134 bash[9858]: cluster 2021-01-28T04:18:07.076182+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v576: 180 pgs: 180 active+clean; 25 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:09.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:08 smithi134 bash[9858]: cluster 2021-01-28T04:18:07.713568+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-28T04:18:09.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:08 smithi134 bash[9858]: audit 2021-01-28T04:18:07.716869+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.150:0/253568272' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:09.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:08 smithi134 bash[9858]: audit 2021-01-28T04:18:07.717993+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:09.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:08 smithi150 bash[9867]: cluster 2021-01-28T04:18:07.076182+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v576: 180 pgs: 180 active+clean; 25 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:09.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:08 smithi150 bash[9867]: cluster 2021-01-28T04:18:07.713568+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-28T04:18:09.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:08 smithi150 bash[9867]: audit 2021-01-28T04:18:07.716869+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.150:0/253568272' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:09.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:08 smithi150 bash[9867]: audit 2021-01-28T04:18:07.717993+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:09.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:08 smithi150 bash[13629]: cluster 2021-01-28T04:18:07.076182+0000 mgr.y (mgr.14138) 589 : cluster [DBG] pgmap v576: 180 pgs: 180 active+clean; 25 KiB data, 195 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:09.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:08 smithi150 bash[13629]: cluster 2021-01-28T04:18:07.713568+0000 mon.a (mon.0) 963 : cluster [DBG] osdmap e204: 8 total, 8 up, 8 in 2021-01-28T04:18:09.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:08 smithi150 bash[13629]: audit 2021-01-28T04:18:07.716869+0000 mon.c (mon.1) 49 : audit [INF] from='client.? 172.21.15.150:0/253568272' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:09.228 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:08 smithi150 bash[13629]: audit 2021-01-28T04:18:07.717993+0000 mon.a (mon.0) 964 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:09.727 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_get_pool_name ... ok 2021-01-28T04:18:10.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:09 smithi134 bash[9858]: audit 2021-01-28T04:18:08.720241+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:10.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:09 smithi134 bash[9858]: cluster 2021-01-28T04:18:08.721309+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-28T04:18:10.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:09 smithi134 bash[9858]: cluster 2021-01-28T04:18:09.719246+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-28T04:18:10.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:09 smithi150 bash[9867]: audit 2021-01-28T04:18:08.720241+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:10.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:09 smithi150 bash[9867]: cluster 2021-01-28T04:18:08.721309+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-28T04:18:10.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:09 smithi150 bash[9867]: cluster 2021-01-28T04:18:09.719246+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-28T04:18:10.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:09 smithi150 bash[13629]: audit 2021-01-28T04:18:08.720241+0000 mon.a (mon.0) 965 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:10.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:09 smithi150 bash[13629]: cluster 2021-01-28T04:18:08.721309+0000 mon.a (mon.0) 966 : cluster [DBG] osdmap e205: 8 total, 8 up, 8 in 2021-01-28T04:18:10.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:09 smithi150 bash[13629]: cluster 2021-01-28T04:18:09.719246+0000 mon.a (mon.0) 967 : cluster [DBG] osdmap e206: 8 total, 8 up, 8 in 2021-01-28T04:18:11.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:10 smithi134 bash[9858]: cluster 2021-01-28T04:18:09.077249+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v579: 212 pgs: 16 creating+peering, 13 unknown, 183 active+clean; 25 KiB data, 200 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:11.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:10 smithi150 bash[9867]: cluster 2021-01-28T04:18:09.077249+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v579: 212 pgs: 16 creating+peering, 13 unknown, 183 active+clean; 25 KiB data, 200 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:11.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:10 smithi150 bash[13629]: cluster 2021-01-28T04:18:09.077249+0000 mgr.y (mgr.14138) 590 : cluster [DBG] pgmap v579: 212 pgs: 16 creating+peering, 13 unknown, 183 active+clean; 25 KiB data, 200 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:11.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:11 smithi150 bash[9867]: cluster 2021-01-28T04:18:10.756587+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-28T04:18:11.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:11 smithi150 bash[9867]: audit 2021-01-28T04:18:10.760707+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.150:0/433759020' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:11.977 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:18:11 smithi150 bash[10146]: debug 2021-01-28T04:18:11.709+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:18:11.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:11 smithi150 bash[13629]: cluster 2021-01-28T04:18:10.756587+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-28T04:18:11.978 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:11 smithi150 bash[13629]: audit 2021-01-28T04:18:10.760707+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.150:0/433759020' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:12.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:18:11 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:18:12.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:11 smithi134 bash[9858]: cluster 2021-01-28T04:18:10.756587+0000 mon.a (mon.0) 968 : cluster [DBG] osdmap e207: 8 total, 8 up, 8 in 2021-01-28T04:18:12.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:11 smithi134 bash[9858]: audit 2021-01-28T04:18:10.760707+0000 mon.a (mon.0) 969 : audit [INF] from='client.? 172.21.15.150:0/433759020' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:12.782 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_get_stats ... ok 2021-01-28T04:18:13.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:12 smithi134 bash[9858]: cluster 2021-01-28T04:18:11.078364+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v582: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 200 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:12 smithi134 bash[9858]: audit 2021-01-28T04:18:11.713123+0000 mgr.y (mgr.14138) 592 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:12 smithi134 bash[9858]: audit 2021-01-28T04:18:11.766448+0000 mon.a (mon.0) 970 : audit [INF] from='client.? 172.21.15.150:0/433759020' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:13.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:12 smithi134 bash[9858]: cluster 2021-01-28T04:18:11.766782+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-28T04:18:13.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:12 smithi150 bash[13629]: cluster 2021-01-28T04:18:11.078364+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v582: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 200 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:13.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:12 smithi150 bash[13629]: audit 2021-01-28T04:18:11.713123+0000 mgr.y (mgr.14138) 592 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:13.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:12 smithi150 bash[13629]: audit 2021-01-28T04:18:11.766448+0000 mon.a (mon.0) 970 : audit [INF] from='client.? 172.21.15.150:0/433759020' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:13.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:12 smithi150 bash[13629]: cluster 2021-01-28T04:18:11.766782+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-28T04:18:13.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:12 smithi150 bash[9867]: cluster 2021-01-28T04:18:11.078364+0000 mgr.y (mgr.14138) 591 : cluster [DBG] pgmap v582: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 200 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:13.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:12 smithi150 bash[9867]: audit 2021-01-28T04:18:11.713123+0000 mgr.y (mgr.14138) 592 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:13.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:12 smithi150 bash[9867]: audit 2021-01-28T04:18:11.766448+0000 mon.a (mon.0) 970 : audit [INF] from='client.? 172.21.15.150:0/433759020' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:13.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:12 smithi150 bash[9867]: cluster 2021-01-28T04:18:11.766782+0000 mon.a (mon.0) 971 : cluster [DBG] osdmap e208: 8 total, 8 up, 8 in 2021-01-28T04:18:14.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:13 smithi134 bash[9858]: cluster 2021-01-28T04:18:12.778356+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-28T04:18:14.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:13 smithi150 bash[9867]: cluster 2021-01-28T04:18:12.778356+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-28T04:18:14.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:13 smithi150 bash[13629]: cluster 2021-01-28T04:18:12.778356+0000 mon.a (mon.0) 972 : cluster [DBG] osdmap e209: 8 total, 8 up, 8 in 2021-01-28T04:18:15.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:14 smithi134 bash[9858]: cluster 2021-01-28T04:18:13.079667+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v585: 180 pgs: 180 active+clean; 25 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:15.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:14 smithi134 bash[9858]: cluster 2021-01-28T04:18:13.797912+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-28T04:18:15.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:14 smithi150 bash[9867]: cluster 2021-01-28T04:18:13.079667+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v585: 180 pgs: 180 active+clean; 25 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:15.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:14 smithi150 bash[9867]: cluster 2021-01-28T04:18:13.797912+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-28T04:18:15.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:14 smithi150 bash[13629]: cluster 2021-01-28T04:18:13.079667+0000 mgr.y (mgr.14138) 593 : cluster [DBG] pgmap v585: 180 pgs: 180 active+clean; 25 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:15.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:14 smithi150 bash[13629]: cluster 2021-01-28T04:18:13.797912+0000 mon.a (mon.0) 973 : cluster [DBG] osdmap e210: 8 total, 8 up, 8 in 2021-01-28T04:18:16.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:15 smithi134 bash[9858]: cluster 2021-01-28T04:18:14.796364+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-28T04:18:16.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:15 smithi134 bash[9858]: audit 2021-01-28T04:18:14.874038+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.150:0/254280845' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:16.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:15 smithi134 bash[9858]: audit 2021-01-28T04:18:14.874669+0000 mon.a (mon.0) 975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:16.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:15 smithi150 bash[9867]: cluster 2021-01-28T04:18:14.796364+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-28T04:18:16.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:15 smithi150 bash[9867]: audit 2021-01-28T04:18:14.874038+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.150:0/254280845' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:16.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:15 smithi150 bash[9867]: audit 2021-01-28T04:18:14.874669+0000 mon.a (mon.0) 975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:16.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:15 smithi150 bash[13629]: cluster 2021-01-28T04:18:14.796364+0000 mon.a (mon.0) 974 : cluster [DBG] osdmap e211: 8 total, 8 up, 8 in 2021-01-28T04:18:16.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:15 smithi150 bash[13629]: audit 2021-01-28T04:18:14.874038+0000 mon.c (mon.1) 50 : audit [INF] from='client.? 172.21.15.150:0/254280845' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:16.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:15 smithi150 bash[13629]: audit 2021-01-28T04:18:14.874669+0000 mon.a (mon.0) 975 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:16.836 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_list_ns_objects ... ok 2021-01-28T04:18:17.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:16 smithi134 bash[9858]: cluster 2021-01-28T04:18:15.080460+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v588: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:17.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:16 smithi134 bash[9858]: audit 2021-01-28T04:18:15.814217+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:17.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:16 smithi134 bash[9858]: cluster 2021-01-28T04:18:15.814318+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-28T04:18:17.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:16 smithi150 bash[9867]: cluster 2021-01-28T04:18:15.080460+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v588: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:17.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:16 smithi150 bash[9867]: audit 2021-01-28T04:18:15.814217+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:17.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:16 smithi150 bash[9867]: cluster 2021-01-28T04:18:15.814318+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-28T04:18:17.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:16 smithi150 bash[13629]: cluster 2021-01-28T04:18:15.080460+0000 mgr.y (mgr.14138) 594 : cluster [DBG] pgmap v588: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 206 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:17.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:16 smithi150 bash[13629]: audit 2021-01-28T04:18:15.814217+0000 mon.a (mon.0) 976 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:17.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:16 smithi150 bash[13629]: cluster 2021-01-28T04:18:15.814318+0000 mon.a (mon.0) 977 : cluster [DBG] osdmap e212: 8 total, 8 up, 8 in 2021-01-28T04:18:18.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:17 smithi134 bash[9858]: cluster 2021-01-28T04:18:16.831825+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-28T04:18:18.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:17 smithi150 bash[9867]: cluster 2021-01-28T04:18:16.831825+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-28T04:18:18.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:17 smithi150 bash[13629]: cluster 2021-01-28T04:18:16.831825+0000 mon.a (mon.0) 978 : cluster [DBG] osdmap e213: 8 total, 8 up, 8 in 2021-01-28T04:18:19.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:18 smithi134 bash[9858]: cluster 2021-01-28T04:18:17.081361+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v591: 180 pgs: 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:19.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:18 smithi134 bash[9858]: cluster 2021-01-28T04:18:17.838933+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-28T04:18:19.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:18 smithi150 bash[9867]: cluster 2021-01-28T04:18:17.081361+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v591: 180 pgs: 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:19.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:18 smithi150 bash[9867]: cluster 2021-01-28T04:18:17.838933+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-28T04:18:19.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:18 smithi150 bash[13629]: cluster 2021-01-28T04:18:17.081361+0000 mgr.y (mgr.14138) 595 : cluster [DBG] pgmap v591: 180 pgs: 180 active+clean; 25 KiB data, 207 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:19.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:18 smithi150 bash[13629]: cluster 2021-01-28T04:18:17.838933+0000 mon.a (mon.0) 979 : cluster [DBG] osdmap e214: 8 total, 8 up, 8 in 2021-01-28T04:18:20.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:19 smithi134 bash[9858]: cluster 2021-01-28T04:18:18.843002+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-28T04:18:20.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:19 smithi134 bash[9858]: audit 2021-01-28T04:18:18.921363+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.150:0/1738104010' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:20.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:19 smithi150 bash[9867]: cluster 2021-01-28T04:18:18.843002+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-28T04:18:20.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:19 smithi150 bash[9867]: audit 2021-01-28T04:18:18.921363+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.150:0/1738104010' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:20.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:19 smithi150 bash[13629]: cluster 2021-01-28T04:18:18.843002+0000 mon.a (mon.0) 980 : cluster [DBG] osdmap e215: 8 total, 8 up, 8 in 2021-01-28T04:18:20.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:19 smithi150 bash[13629]: audit 2021-01-28T04:18:18.921363+0000 mon.a (mon.0) 981 : audit [INF] from='client.? 172.21.15.150:0/1738104010' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:20.875 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_list_objects ... ok 2021-01-28T04:18:21.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:20 smithi134 bash[9858]: cluster 2021-01-28T04:18:19.082418+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v594: 212 pgs: 4 creating+activating, 17 creating+peering, 11 unknown, 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:21.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:20 smithi134 bash[9858]: audit 2021-01-28T04:18:19.863825+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.150:0/1738104010' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:21.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:20 smithi134 bash[9858]: cluster 2021-01-28T04:18:19.863911+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-28T04:18:21.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:20 smithi150 bash[13629]: cluster 2021-01-28T04:18:19.082418+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v594: 212 pgs: 4 creating+activating, 17 creating+peering, 11 unknown, 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:21.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:20 smithi150 bash[13629]: audit 2021-01-28T04:18:19.863825+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.150:0/1738104010' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:21.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:20 smithi150 bash[13629]: cluster 2021-01-28T04:18:19.863911+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-28T04:18:21.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:20 smithi150 bash[9867]: cluster 2021-01-28T04:18:19.082418+0000 mgr.y (mgr.14138) 596 : cluster [DBG] pgmap v594: 212 pgs: 4 creating+activating, 17 creating+peering, 11 unknown, 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:21.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:20 smithi150 bash[9867]: audit 2021-01-28T04:18:19.863825+0000 mon.a (mon.0) 982 : audit [INF] from='client.? 172.21.15.150:0/1738104010' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:21.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:20 smithi150 bash[9867]: cluster 2021-01-28T04:18:19.863911+0000 mon.a (mon.0) 983 : cluster [DBG] osdmap e216: 8 total, 8 up, 8 in 2021-01-28T04:18:21.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:21 smithi150 bash[9867]: cluster 2021-01-28T04:18:20.869115+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-28T04:18:21.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:21 smithi150 bash[9867]: audit 2021-01-28T04:18:21.325389+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:18:21.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:21 smithi150 bash[9867]: audit 2021-01-28T04:18:21.326483+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:18:21.977 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:18:21 smithi150 bash[10146]: debug 2021-01-28T04:18:21.721+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:18:21.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:21 smithi150 bash[13629]: cluster 2021-01-28T04:18:20.869115+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-28T04:18:21.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:21 smithi150 bash[13629]: audit 2021-01-28T04:18:21.325389+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:18:21.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:21 smithi150 bash[13629]: audit 2021-01-28T04:18:21.326483+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:18:22.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:18:21 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:18:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:21 smithi134 bash[9858]: cluster 2021-01-28T04:18:20.869115+0000 mon.a (mon.0) 984 : cluster [DBG] osdmap e217: 8 total, 8 up, 8 in 2021-01-28T04:18:22.137 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:21 smithi134 bash[9858]: audit 2021-01-28T04:18:21.325389+0000 mon.a (mon.0) 985 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2021-01-28T04:18:22.138 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:21 smithi134 bash[9858]: audit 2021-01-28T04:18:21.326483+0000 mon.a (mon.0) 986 : audit [INF] from='mgr.14138 172.21.15.150:0/807373558' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2021-01-28T04:18:23.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:22 smithi150 bash[9867]: cluster 2021-01-28T04:18:21.083198+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v597: 180 pgs: 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:23.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:22 smithi150 bash[9867]: audit 2021-01-28T04:18:21.724392+0000 mgr.y (mgr.14138) 598 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:23.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:22 smithi150 bash[9867]: cluster 2021-01-28T04:18:21.897696+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-28T04:18:23.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:22 smithi150 bash[13629]: cluster 2021-01-28T04:18:21.083198+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v597: 180 pgs: 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:23.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:22 smithi150 bash[13629]: audit 2021-01-28T04:18:21.724392+0000 mgr.y (mgr.14138) 598 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:23.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:22 smithi150 bash[13629]: cluster 2021-01-28T04:18:21.897696+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-28T04:18:23.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:22 smithi134 bash[9858]: cluster 2021-01-28T04:18:21.083198+0000 mgr.y (mgr.14138) 597 : cluster [DBG] pgmap v597: 180 pgs: 180 active+clean; 25 KiB data, 208 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:23.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:22 smithi134 bash[9858]: audit 2021-01-28T04:18:21.724392+0000 mgr.y (mgr.14138) 598 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:23.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:22 smithi134 bash[9858]: cluster 2021-01-28T04:18:21.897696+0000 mon.a (mon.0) 987 : cluster [DBG] osdmap e218: 8 total, 8 up, 8 in 2021-01-28T04:18:24.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:23 smithi150 bash[9867]: cluster 2021-01-28T04:18:22.907971+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-28T04:18:24.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:23 smithi150 bash[9867]: audit 2021-01-28T04:18:22.961279+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.150:0/2952016848' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:24.228 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:23 smithi150 bash[9867]: audit 2021-01-28T04:18:22.961727+0000 mon.a (mon.0) 989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:24.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:23 smithi150 bash[13629]: cluster 2021-01-28T04:18:22.907971+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-28T04:18:24.229 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:23 smithi150 bash[13629]: audit 2021-01-28T04:18:22.961279+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.150:0/2952016848' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:24.230 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:23 smithi150 bash[13629]: audit 2021-01-28T04:18:22.961727+0000 mon.a (mon.0) 989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:24.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:23 smithi134 bash[9858]: cluster 2021-01-28T04:18:22.907971+0000 mon.a (mon.0) 988 : cluster [DBG] osdmap e219: 8 total, 8 up, 8 in 2021-01-28T04:18:24.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:23 smithi134 bash[9858]: audit 2021-01-28T04:18:22.961279+0000 mon.c (mon.1) 51 : audit [INF] from='client.? 172.21.15.150:0/2952016848' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:24.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:23 smithi134 bash[9858]: audit 2021-01-28T04:18:22.961727+0000 mon.a (mon.0) 989 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:24.923 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_list_objects_empty ... ok 2021-01-28T04:18:25.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:24 smithi150 bash[13629]: cluster 2021-01-28T04:18:23.084442+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v600: 212 pgs: 5 creating+peering, 11 unknown, 196 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:25.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:24 smithi150 bash[13629]: audit 2021-01-28T04:18:23.913680+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:25.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:24 smithi150 bash[13629]: cluster 2021-01-28T04:18:23.913811+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-28T04:18:25.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:24 smithi150 bash[13629]: cluster 2021-01-28T04:18:24.918644+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-28T04:18:25.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:24 smithi150 bash[9867]: cluster 2021-01-28T04:18:23.084442+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v600: 212 pgs: 5 creating+peering, 11 unknown, 196 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:25.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:24 smithi150 bash[9867]: audit 2021-01-28T04:18:23.913680+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:25.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:24 smithi150 bash[9867]: cluster 2021-01-28T04:18:23.913811+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-28T04:18:25.227 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:24 smithi150 bash[9867]: cluster 2021-01-28T04:18:24.918644+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-28T04:18:25.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:24 smithi134 bash[9858]: cluster 2021-01-28T04:18:23.084442+0000 mgr.y (mgr.14138) 599 : cluster [DBG] pgmap v600: 212 pgs: 5 creating+peering, 11 unknown, 196 active+clean; 25 KiB data, 209 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:25.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:24 smithi134 bash[9858]: audit 2021-01-28T04:18:23.913680+0000 mon.a (mon.0) 990 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:25.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:24 smithi134 bash[9858]: cluster 2021-01-28T04:18:23.913811+0000 mon.a (mon.0) 991 : cluster [DBG] osdmap e220: 8 total, 8 up, 8 in 2021-01-28T04:18:25.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:24 smithi134 bash[9858]: cluster 2021-01-28T04:18:24.918644+0000 mon.a (mon.0) 992 : cluster [DBG] osdmap e221: 8 total, 8 up, 8 in 2021-01-28T04:18:27.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:26 smithi150 bash[9867]: cluster 2021-01-28T04:18:25.085188+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v603: 180 pgs: 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:27.226 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:26 smithi150 bash[9867]: cluster 2021-01-28T04:18:25.946999+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-28T04:18:27.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:26 smithi150 bash[13629]: cluster 2021-01-28T04:18:25.085188+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v603: 180 pgs: 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:27.227 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:26 smithi150 bash[13629]: cluster 2021-01-28T04:18:25.946999+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-28T04:18:27.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:26 smithi134 bash[9858]: cluster 2021-01-28T04:18:25.085188+0000 mgr.y (mgr.14138) 600 : cluster [DBG] pgmap v603: 180 pgs: 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:27.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:26 smithi134 bash[9858]: cluster 2021-01-28T04:18:25.946999+0000 mon.a (mon.0) 993 : cluster [DBG] osdmap e222: 8 total, 8 up, 8 in 2021-01-28T04:18:28.225 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:27 smithi150 bash[9867]: cluster 2021-01-28T04:18:26.953965+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-28T04:18:28.226 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:27 smithi150 bash[13629]: cluster 2021-01-28T04:18:26.953965+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-28T04:18:28.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:27 smithi134 bash[9858]: cluster 2021-01-28T04:18:26.953965+0000 mon.a (mon.0) 994 : cluster [DBG] osdmap e223: 8 total, 8 up, 8 in 2021-01-28T04:18:29.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:28 smithi134 bash[9858]: cluster 2021-01-28T04:18:27.086226+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v606: 212 pgs: 5 creating+activating, 27 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:29.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:28 smithi134 bash[9858]: cluster 2021-01-28T04:18:27.976603+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-28T04:18:29.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:28 smithi150 bash[13629]: cluster 2021-01-28T04:18:27.086226+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v606: 212 pgs: 5 creating+activating, 27 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:29.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:28 smithi150 bash[13629]: cluster 2021-01-28T04:18:27.976603+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-28T04:18:29.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:28 smithi150 bash[9867]: cluster 2021-01-28T04:18:27.086226+0000 mgr.y (mgr.14138) 601 : cluster [DBG] pgmap v606: 212 pgs: 5 creating+activating, 27 unknown, 180 active+clean; 25 KiB data, 210 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:29.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:28 smithi150 bash[9867]: cluster 2021-01-28T04:18:27.976603+0000 mon.a (mon.0) 995 : cluster [DBG] osdmap e224: 8 total, 8 up, 8 in 2021-01-28T04:18:30.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:29 smithi134 bash[9858]: cluster 2021-01-28T04:18:28.982273+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-28T04:18:30.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:29 smithi134 bash[9858]: audit 2021-01-28T04:18:28.987394+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.150:0/1206135791' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:30.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:29 smithi134 bash[9858]: audit 2021-01-28T04:18:28.988264+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:30.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:29 smithi134 bash[9858]: audit 2021-01-28T04:18:29.985806+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:30.388 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:29 smithi134 bash[9858]: cluster 2021-01-28T04:18:29.986405+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-28T04:18:30.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[13629]: cluster 2021-01-28T04:18:28.982273+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-28T04:18:30.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[13629]: audit 2021-01-28T04:18:28.987394+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.150:0/1206135791' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:30.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[13629]: audit 2021-01-28T04:18:28.988264+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:30.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[13629]: audit 2021-01-28T04:18:29.985806+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:30.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[13629]: cluster 2021-01-28T04:18:29.986405+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-28T04:18:30.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[9867]: cluster 2021-01-28T04:18:28.982273+0000 mon.a (mon.0) 996 : cluster [DBG] osdmap e225: 8 total, 8 up, 8 in 2021-01-28T04:18:30.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[9867]: audit 2021-01-28T04:18:28.987394+0000 mon.c (mon.1) 52 : audit [INF] from='client.? 172.21.15.150:0/1206135791' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:30.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[9867]: audit 2021-01-28T04:18:28.988264+0000 mon.a (mon.0) 997 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:30.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[9867]: audit 2021-01-28T04:18:29.985806+0000 mon.a (mon.0) 998 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:30.478 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:29 smithi150 bash[9867]: cluster 2021-01-28T04:18:29.986405+0000 mon.a (mon.0) 999 : cluster [DBG] osdmap e226: 8 total, 8 up, 8 in 2021-01-28T04:18:30.998 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_list_snaps ... ok 2021-01-28T04:18:31.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:31 smithi134 bash[9858]: cluster 2021-01-28T04:18:29.087063+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v609: 212 pgs: 5 creating+activating, 2 unknown, 205 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:31.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:31 smithi134 bash[9858]: cluster 2021-01-28T04:18:30.989830+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-28T04:18:31.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:31 smithi150 bash[9867]: cluster 2021-01-28T04:18:29.087063+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v609: 212 pgs: 5 creating+activating, 2 unknown, 205 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:31.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:31 smithi150 bash[9867]: cluster 2021-01-28T04:18:30.989830+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-28T04:18:31.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:31 smithi150 bash[13629]: cluster 2021-01-28T04:18:29.087063+0000 mgr.y (mgr.14138) 602 : cluster [DBG] pgmap v609: 212 pgs: 5 creating+activating, 2 unknown, 205 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:31.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:31 smithi150 bash[13629]: cluster 2021-01-28T04:18:30.989830+0000 mon.a (mon.0) 1000 : cluster [DBG] osdmap e227: 8 total, 8 up, 8 in 2021-01-28T04:18:32.137 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:18:31 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:18:32.226 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:18:31 smithi150 bash[10146]: debug 2021-01-28T04:18:31.733+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:18:33.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:33 smithi134 bash[9858]: cluster 2021-01-28T04:18:31.087801+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:33.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:33 smithi134 bash[9858]: audit 2021-01-28T04:18:31.735067+0000 mgr.y (mgr.14138) 604 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:33.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:33 smithi134 bash[9858]: cluster 2021-01-28T04:18:32.023700+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-28T04:18:33.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:33 smithi134 bash[9858]: audit 2021-01-28T04:18:32.026053+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? 172.21.15.150:0/3774964633' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:33.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:33 smithi150 bash[9867]: cluster 2021-01-28T04:18:31.087801+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:33.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:33 smithi150 bash[9867]: audit 2021-01-28T04:18:31.735067+0000 mgr.y (mgr.14138) 604 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:33.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:33 smithi150 bash[9867]: cluster 2021-01-28T04:18:32.023700+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-28T04:18:33.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:33 smithi150 bash[9867]: audit 2021-01-28T04:18:32.026053+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? 172.21.15.150:0/3774964633' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:33.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:33 smithi150 bash[13629]: cluster 2021-01-28T04:18:31.087801+0000 mgr.y (mgr.14138) 603 : cluster [DBG] pgmap v612: 180 pgs: 180 active+clean; 25 KiB data, 212 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:33.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:33 smithi150 bash[13629]: audit 2021-01-28T04:18:31.735067+0000 mgr.y (mgr.14138) 604 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:33.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:33 smithi150 bash[13629]: cluster 2021-01-28T04:18:32.023700+0000 mon.a (mon.0) 1001 : cluster [DBG] osdmap e228: 8 total, 8 up, 8 in 2021-01-28T04:18:33.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:33 smithi150 bash[13629]: audit 2021-01-28T04:18:32.026053+0000 mon.a (mon.0) 1002 : audit [INF] from='client.? 172.21.15.150:0/3774964633' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:34.048 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_list_snaps_empty ... ok 2021-01-28T04:18:34.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:34 smithi134 bash[9858]: audit 2021-01-28T04:18:33.031448+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? 172.21.15.150:0/3774964633' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:34.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:34 smithi134 bash[9858]: cluster 2021-01-28T04:18:33.031844+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-28T04:18:34.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:34 smithi150 bash[9867]: audit 2021-01-28T04:18:33.031448+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? 172.21.15.150:0/3774964633' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:34.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:34 smithi150 bash[9867]: cluster 2021-01-28T04:18:33.031844+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-28T04:18:34.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:34 smithi150 bash[13629]: audit 2021-01-28T04:18:33.031448+0000 mon.a (mon.0) 1003 : audit [INF] from='client.? 172.21.15.150:0/3774964633' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:34.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:34 smithi150 bash[13629]: cluster 2021-01-28T04:18:33.031844+0000 mon.a (mon.0) 1004 : cluster [DBG] osdmap e229: 8 total, 8 up, 8 in 2021-01-28T04:18:35.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:35 smithi134 bash[9858]: cluster 2021-01-28T04:18:33.088624+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v615: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:35.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:35 smithi134 bash[9858]: cluster 2021-01-28T04:18:34.045164+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-28T04:18:35.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:35 smithi150 bash[13629]: cluster 2021-01-28T04:18:33.088624+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v615: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:35.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:35 smithi150 bash[13629]: cluster 2021-01-28T04:18:34.045164+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-28T04:18:35.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:35 smithi150 bash[9867]: cluster 2021-01-28T04:18:33.088624+0000 mgr.y (mgr.14138) 605 : cluster [DBG] pgmap v615: 212 pgs: 12 creating+peering, 20 unknown, 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:35.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:35 smithi150 bash[9867]: cluster 2021-01-28T04:18:34.045164+0000 mon.a (mon.0) 1005 : cluster [DBG] osdmap e230: 8 total, 8 up, 8 in 2021-01-28T04:18:36.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:36 smithi134 bash[9858]: cluster 2021-01-28T04:18:35.052291+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-28T04:18:36.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:36 smithi150 bash[13629]: cluster 2021-01-28T04:18:35.052291+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-28T04:18:36.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:36 smithi150 bash[9867]: cluster 2021-01-28T04:18:35.052291+0000 mon.a (mon.0) 1006 : cluster [DBG] osdmap e231: 8 total, 8 up, 8 in 2021-01-28T04:18:37.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:37 smithi134 bash[9858]: cluster 2021-01-28T04:18:35.089302+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v618: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:37.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:37 smithi134 bash[9858]: cluster 2021-01-28T04:18:36.063364+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-28T04:18:37.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:37 smithi134 bash[9858]: audit 2021-01-28T04:18:36.149898+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.150:0/1733605565' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:37.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:37 smithi134 bash[9858]: audit 2021-01-28T04:18:36.150741+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:37.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:37 smithi150 bash[9867]: cluster 2021-01-28T04:18:35.089302+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v618: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:37.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:37 smithi150 bash[9867]: cluster 2021-01-28T04:18:36.063364+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-28T04:18:37.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:37 smithi150 bash[9867]: audit 2021-01-28T04:18:36.149898+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.150:0/1733605565' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:37.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:37 smithi150 bash[9867]: audit 2021-01-28T04:18:36.150741+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:37.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:37 smithi150 bash[13629]: cluster 2021-01-28T04:18:35.089302+0000 mgr.y (mgr.14138) 606 : cluster [DBG] pgmap v618: 212 pgs: 32 unknown, 180 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:37.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:37 smithi150 bash[13629]: cluster 2021-01-28T04:18:36.063364+0000 mon.a (mon.0) 1007 : cluster [DBG] osdmap e232: 8 total, 8 up, 8 in 2021-01-28T04:18:37.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:37 smithi150 bash[13629]: audit 2021-01-28T04:18:36.149898+0000 mon.c (mon.1) 53 : audit [INF] from='client.? 172.21.15.150:0/1733605565' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:37.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:37 smithi150 bash[13629]: audit 2021-01-28T04:18:36.150741+0000 mon.a (mon.0) 1008 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:38.101 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_locator ... ok 2021-01-28T04:18:38.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:38 smithi134 bash[9858]: audit 2021-01-28T04:18:37.067636+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:38.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:38 smithi134 bash[9858]: cluster 2021-01-28T04:18:37.067775+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-28T04:18:38.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:38 smithi134 bash[9858]: cluster 2021-01-28T04:18:37.089976+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v621: 212 pgs: 29 unknown, 183 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:38.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:38 smithi150 bash[9867]: audit 2021-01-28T04:18:37.067636+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:38.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:38 smithi150 bash[9867]: cluster 2021-01-28T04:18:37.067775+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-28T04:18:38.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:38 smithi150 bash[9867]: cluster 2021-01-28T04:18:37.089976+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v621: 212 pgs: 29 unknown, 183 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:38.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:38 smithi150 bash[13629]: audit 2021-01-28T04:18:37.067636+0000 mon.a (mon.0) 1009 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:38.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:38 smithi150 bash[13629]: cluster 2021-01-28T04:18:37.067775+0000 mon.a (mon.0) 1010 : cluster [DBG] osdmap e233: 8 total, 8 up, 8 in 2021-01-28T04:18:38.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:38 smithi150 bash[13629]: cluster 2021-01-28T04:18:37.089976+0000 mgr.y (mgr.14138) 607 : cluster [DBG] pgmap v621: 212 pgs: 29 unknown, 183 active+clean; 25 KiB data, 213 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:39.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:39 smithi134 bash[9858]: cluster 2021-01-28T04:18:38.095841+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-28T04:18:39.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:39 smithi150 bash[9867]: cluster 2021-01-28T04:18:38.095841+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-28T04:18:39.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:39 smithi150 bash[13629]: cluster 2021-01-28T04:18:38.095841+0000 mon.a (mon.0) 1011 : cluster [DBG] osdmap e234: 8 total, 8 up, 8 in 2021-01-28T04:18:40.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:40 smithi134 bash[9858]: cluster 2021-01-28T04:18:39.091102+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v623: 180 pgs: 180 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:40.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:40 smithi134 bash[9858]: cluster 2021-01-28T04:18:39.102333+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-28T04:18:40.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:40 smithi150 bash[9867]: cluster 2021-01-28T04:18:39.091102+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v623: 180 pgs: 180 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:40.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:40 smithi150 bash[9867]: cluster 2021-01-28T04:18:39.102333+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-28T04:18:40.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:40 smithi150 bash[13629]: cluster 2021-01-28T04:18:39.091102+0000 mgr.y (mgr.14138) 608 : cluster [DBG] pgmap v623: 180 pgs: 180 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:40.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:40 smithi150 bash[13629]: cluster 2021-01-28T04:18:39.102333+0000 mon.a (mon.0) 1012 : cluster [DBG] osdmap e235: 8 total, 8 up, 8 in 2021-01-28T04:18:41.386 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:41 smithi134 bash[9858]: cluster 2021-01-28T04:18:40.113329+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-28T04:18:41.387 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:41 smithi134 bash[9858]: audit 2021-01-28T04:18:40.163177+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.150:0/3259232270' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:41.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:41 smithi150 bash[9867]: cluster 2021-01-28T04:18:40.113329+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-28T04:18:41.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:41 smithi150 bash[9867]: audit 2021-01-28T04:18:40.163177+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.150:0/3259232270' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:41.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:41 smithi150 bash[13629]: cluster 2021-01-28T04:18:40.113329+0000 mon.a (mon.0) 1013 : cluster [DBG] osdmap e236: 8 total, 8 up, 8 in 2021-01-28T04:18:41.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:41 smithi150 bash[13629]: audit 2021-01-28T04:18:40.163177+0000 mon.a (mon.0) 1014 : audit [INF] from='client.? 172.21.15.150:0/3259232270' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:42.136 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:18:41 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:18:42.142 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_lock ... ok 2021-01-28T04:18:42.145 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:18:41 smithi150 bash[10146]: debug 2021-01-28T04:18:41.740+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:18:42.145 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:42 smithi150 bash[9867]: cluster 2021-01-28T04:18:41.091821+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v626: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:42.146 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:42 smithi150 bash[9867]: audit 2021-01-28T04:18:41.132240+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? 172.21.15.150:0/3259232270' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:42.146 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:42 smithi150 bash[9867]: cluster 2021-01-28T04:18:41.132343+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-28T04:18:42.146 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:42 smithi150 bash[9867]: audit 2021-01-28T04:18:41.743467+0000 mgr.y (mgr.14138) 610 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:42.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:42 smithi150 bash[13629]: cluster 2021-01-28T04:18:41.091821+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v626: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:42.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:42 smithi150 bash[13629]: audit 2021-01-28T04:18:41.132240+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? 172.21.15.150:0/3259232270' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:42.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:42 smithi150 bash[13629]: cluster 2021-01-28T04:18:41.132343+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-28T04:18:42.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:42 smithi150 bash[13629]: audit 2021-01-28T04:18:41.743467+0000 mgr.y (mgr.14138) 610 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:42.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:42 smithi134 bash[9858]: cluster 2021-01-28T04:18:41.091821+0000 mgr.y (mgr.14138) 609 : cluster [DBG] pgmap v626: 212 pgs: 2 creating+peering, 30 unknown, 180 active+clean; 25 KiB data, 215 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:42.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:42 smithi134 bash[9858]: audit 2021-01-28T04:18:41.132240+0000 mon.a (mon.0) 1015 : audit [INF] from='client.? 172.21.15.150:0/3259232270' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:42.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:42 smithi134 bash[9858]: cluster 2021-01-28T04:18:41.132343+0000 mon.a (mon.0) 1016 : cluster [DBG] osdmap e237: 8 total, 8 up, 8 in 2021-01-28T04:18:42.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:42 smithi134 bash[9858]: audit 2021-01-28T04:18:41.743467+0000 mgr.y (mgr.14138) 610 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:43.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:43 smithi150 bash[9867]: cluster 2021-01-28T04:18:42.136012+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-28T04:18:43.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:43 smithi150 bash[13629]: cluster 2021-01-28T04:18:42.136012+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-28T04:18:43.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:43 smithi134 bash[9858]: cluster 2021-01-28T04:18:42.136012+0000 mon.a (mon.0) 1017 : cluster [DBG] osdmap e238: 8 total, 8 up, 8 in 2021-01-28T04:18:44.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:44 smithi150 bash[9867]: cluster 2021-01-28T04:18:43.093141+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v629: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:44.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:44 smithi150 bash[9867]: cluster 2021-01-28T04:18:43.161138+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-28T04:18:44.479 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:44 smithi150 bash[13629]: cluster 2021-01-28T04:18:43.093141+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v629: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:44.479 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:44 smithi150 bash[13629]: cluster 2021-01-28T04:18:43.161138+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-28T04:18:44.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:44 smithi134 bash[9858]: cluster 2021-01-28T04:18:43.093141+0000 mgr.y (mgr.14138) 611 : cluster [DBG] pgmap v629: 180 pgs: 180 active+clean; 25 KiB data, 216 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:44.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:44 smithi134 bash[9858]: cluster 2021-01-28T04:18:43.161138+0000 mon.a (mon.0) 1018 : cluster [DBG] osdmap e239: 8 total, 8 up, 8 in 2021-01-28T04:18:45.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:45 smithi150 bash[9867]: cluster 2021-01-28T04:18:44.176860+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-28T04:18:45.477 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:45 smithi150 bash[9867]: audit 2021-01-28T04:18:44.178897+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? 172.21.15.150:0/3125740834' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:45.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:45 smithi150 bash[13629]: cluster 2021-01-28T04:18:44.176860+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-28T04:18:45.478 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:45 smithi150 bash[13629]: audit 2021-01-28T04:18:44.178897+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? 172.21.15.150:0/3125740834' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:45.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:45 smithi134 bash[9858]: cluster 2021-01-28T04:18:44.176860+0000 mon.a (mon.0) 1019 : cluster [DBG] osdmap e240: 8 total, 8 up, 8 in 2021-01-28T04:18:45.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:45 smithi134 bash[9858]: audit 2021-01-28T04:18:44.178897+0000 mon.a (mon.0) 1020 : audit [INF] from='client.? 172.21.15.150:0/3125740834' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:46.193 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_lookup_snap ... ok 2021-01-28T04:18:46.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:46 smithi150 bash[9867]: cluster 2021-01-28T04:18:45.094108+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v632: 212 pgs: 6 creating+peering, 25 unknown, 181 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:46.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:46 smithi150 bash[9867]: audit 2021-01-28T04:18:45.184678+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.150:0/3125740834' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:46.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:46 smithi150 bash[9867]: cluster 2021-01-28T04:18:45.184784+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-28T04:18:46.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:46 smithi150 bash[13629]: cluster 2021-01-28T04:18:45.094108+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v632: 212 pgs: 6 creating+peering, 25 unknown, 181 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:46.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:46 smithi150 bash[13629]: audit 2021-01-28T04:18:45.184678+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.150:0/3125740834' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:46.477 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:46 smithi150 bash[13629]: cluster 2021-01-28T04:18:45.184784+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-28T04:18:46.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:46 smithi134 bash[9858]: cluster 2021-01-28T04:18:45.094108+0000 mgr.y (mgr.14138) 612 : cluster [DBG] pgmap v632: 212 pgs: 6 creating+peering, 25 unknown, 181 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:46.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:46 smithi134 bash[9858]: audit 2021-01-28T04:18:45.184678+0000 mon.a (mon.0) 1021 : audit [INF] from='client.? 172.21.15.150:0/3125740834' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:46.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:46 smithi134 bash[9858]: cluster 2021-01-28T04:18:45.184784+0000 mon.a (mon.0) 1022 : cluster [DBG] osdmap e241: 8 total, 8 up, 8 in 2021-01-28T04:18:47.476 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:47 smithi150 bash[9867]: cluster 2021-01-28T04:18:46.189931+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-28T04:18:47.476 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:47 smithi150 bash[13629]: cluster 2021-01-28T04:18:46.189931+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-28T04:18:47.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:47 smithi134 bash[9858]: cluster 2021-01-28T04:18:46.189931+0000 mon.a (mon.0) 1023 : cluster [DBG] osdmap e242: 8 total, 8 up, 8 in 2021-01-28T04:18:48.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:48 smithi134 bash[9858]: cluster 2021-01-28T04:18:47.095080+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v635: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:48.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:48 smithi134 bash[9858]: cluster 2021-01-28T04:18:47.210562+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-28T04:18:48.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:48 smithi150 bash[9867]: cluster 2021-01-28T04:18:47.095080+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v635: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:48.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:48 smithi150 bash[9867]: cluster 2021-01-28T04:18:47.210562+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-28T04:18:48.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:48 smithi150 bash[13629]: cluster 2021-01-28T04:18:47.095080+0000 mgr.y (mgr.14138) 613 : cluster [DBG] pgmap v635: 180 pgs: 180 active+clean; 25 KiB data, 217 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:48.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:48 smithi150 bash[13629]: cluster 2021-01-28T04:18:47.210562+0000 mon.a (mon.0) 1024 : cluster [DBG] osdmap e243: 8 total, 8 up, 8 in 2021-01-28T04:18:49.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:49 smithi134 bash[9858]: cluster 2021-01-28T04:18:48.217027+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-28T04:18:49.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:49 smithi134 bash[9858]: audit 2021-01-28T04:18:48.299159+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? 172.21.15.150:0/3186437039' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:49.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:49 smithi150 bash[9867]: cluster 2021-01-28T04:18:48.217027+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-28T04:18:49.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:49 smithi150 bash[9867]: audit 2021-01-28T04:18:48.299159+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? 172.21.15.150:0/3186437039' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:49.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:49 smithi150 bash[13629]: cluster 2021-01-28T04:18:48.217027+0000 mon.a (mon.0) 1025 : cluster [DBG] osdmap e244: 8 total, 8 up, 8 in 2021-01-28T04:18:49.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:49 smithi150 bash[13629]: audit 2021-01-28T04:18:48.299159+0000 mon.a (mon.0) 1026 : audit [INF] from='client.? 172.21.15.150:0/3186437039' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:50.257 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_obj_xattrs ... ok 2021-01-28T04:18:50.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:50 smithi134 bash[9858]: cluster 2021-01-28T04:18:49.096540+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v638: 212 pgs: 11 creating+peering, 12 unknown, 189 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 4 op/s 2021-01-28T04:18:50.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:50 smithi134 bash[9858]: cluster 2021-01-28T04:18:49.232663+0000 mon.a (mon.0) 1027 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:18:50.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:50 smithi134 bash[9858]: audit 2021-01-28T04:18:49.241277+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.150:0/3186437039' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:50.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:50 smithi134 bash[9858]: cluster 2021-01-28T04:18:49.241626+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-28T04:18:50.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:50 smithi150 bash[9867]: cluster 2021-01-28T04:18:49.096540+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v638: 212 pgs: 11 creating+peering, 12 unknown, 189 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 4 op/s 2021-01-28T04:18:50.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:50 smithi150 bash[9867]: cluster 2021-01-28T04:18:49.232663+0000 mon.a (mon.0) 1027 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:18:50.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:50 smithi150 bash[9867]: audit 2021-01-28T04:18:49.241277+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.150:0/3186437039' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:50.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:50 smithi150 bash[9867]: cluster 2021-01-28T04:18:49.241626+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-28T04:18:50.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:50 smithi150 bash[13629]: cluster 2021-01-28T04:18:49.096540+0000 mgr.y (mgr.14138) 614 : cluster [DBG] pgmap v638: 212 pgs: 11 creating+peering, 12 unknown, 189 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail; 2.7 KiB/s rd, 0 B/s wr, 4 op/s 2021-01-28T04:18:50.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:50 smithi150 bash[13629]: cluster 2021-01-28T04:18:49.232663+0000 mon.a (mon.0) 1027 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:18:50.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:50 smithi150 bash[13629]: audit 2021-01-28T04:18:49.241277+0000 mon.a (mon.0) 1028 : audit [INF] from='client.? 172.21.15.150:0/3186437039' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:50.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:50 smithi150 bash[13629]: cluster 2021-01-28T04:18:49.241626+0000 mon.a (mon.0) 1029 : cluster [DBG] osdmap e245: 8 total, 8 up, 8 in 2021-01-28T04:18:51.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:51 smithi134 bash[9858]: cluster 2021-01-28T04:18:50.247978+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-28T04:18:51.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:51 smithi150 bash[9867]: cluster 2021-01-28T04:18:50.247978+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-28T04:18:51.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:51 smithi150 bash[13629]: cluster 2021-01-28T04:18:50.247978+0000 mon.a (mon.0) 1030 : cluster [DBG] osdmap e246: 8 total, 8 up, 8 in 2021-01-28T04:18:52.136 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:18:51 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:18:52.226 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:18:51 smithi150 bash[10146]: debug 2021-01-28T04:18:51.752+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:18:52.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:52 smithi134 bash[9858]: cluster 2021-01-28T04:18:51.097325+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v641: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:52.654 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:52 smithi134 bash[9858]: cluster 2021-01-28T04:18:51.254446+0000 mon.a (mon.0) 1031 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:18:52.654 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:52 smithi134 bash[9858]: cluster 2021-01-28T04:18:51.254543+0000 mon.a (mon.0) 1032 : cluster [INF] Cluster is now healthy 2021-01-28T04:18:52.655 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:52 smithi134 bash[9858]: cluster 2021-01-28T04:18:51.270399+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-28T04:18:52.655 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:52 smithi134 bash[9858]: audit 2021-01-28T04:18:51.754706+0000 mgr.y (mgr.14138) 616 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:52.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[9867]: cluster 2021-01-28T04:18:51.097325+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v641: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:52.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[9867]: cluster 2021-01-28T04:18:51.254446+0000 mon.a (mon.0) 1031 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:18:52.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[9867]: cluster 2021-01-28T04:18:51.254543+0000 mon.a (mon.0) 1032 : cluster [INF] Cluster is now healthy 2021-01-28T04:18:52.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[9867]: cluster 2021-01-28T04:18:51.270399+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-28T04:18:52.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[9867]: audit 2021-01-28T04:18:51.754706+0000 mgr.y (mgr.14138) 616 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:52.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[13629]: cluster 2021-01-28T04:18:51.097325+0000 mgr.y (mgr.14138) 615 : cluster [DBG] pgmap v641: 180 pgs: 180 active+clean; 25 KiB data, 219 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:52.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[13629]: cluster 2021-01-28T04:18:51.254446+0000 mon.a (mon.0) 1031 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:18:52.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[13629]: cluster 2021-01-28T04:18:51.254543+0000 mon.a (mon.0) 1032 : cluster [INF] Cluster is now healthy 2021-01-28T04:18:52.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[13629]: cluster 2021-01-28T04:18:51.270399+0000 mon.a (mon.0) 1033 : cluster [DBG] osdmap e247: 8 total, 8 up, 8 in 2021-01-28T04:18:52.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:52 smithi150 bash[13629]: audit 2021-01-28T04:18:51.754706+0000 mgr.y (mgr.14138) 616 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:18:53.638 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:53 smithi134 bash[9858]: cluster 2021-01-28T04:18:52.279773+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-28T04:18:53.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:53 smithi134 bash[9858]: audit 2021-01-28T04:18:52.312207+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.150:0/4095704694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:53.639 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:53 smithi134 bash[9858]: audit 2021-01-28T04:18:52.312727+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:53.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:53 smithi150 bash[9867]: cluster 2021-01-28T04:18:52.279773+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-28T04:18:53.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:53 smithi150 bash[9867]: audit 2021-01-28T04:18:52.312207+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.150:0/4095704694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:53.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:53 smithi150 bash[9867]: audit 2021-01-28T04:18:52.312727+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:53.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:53 smithi150 bash[13629]: cluster 2021-01-28T04:18:52.279773+0000 mon.a (mon.0) 1034 : cluster [DBG] osdmap e248: 8 total, 8 up, 8 in 2021-01-28T04:18:53.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:53 smithi150 bash[13629]: audit 2021-01-28T04:18:52.312207+0000 mon.c (mon.1) 54 : audit [INF] from='client.? 172.21.15.150:0/4095704694' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:53.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:53 smithi150 bash[13629]: audit 2021-01-28T04:18:52.312727+0000 mon.a (mon.0) 1035 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:54.311 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_operate_aio_write_op ... ok 2021-01-28T04:18:54.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:54 smithi134 bash[9858]: cluster 2021-01-28T04:18:53.098730+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v644: 212 pgs: 4 creating+peering, 12 unknown, 196 active+clean; 25 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:54.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:54 smithi134 bash[9858]: audit 2021-01-28T04:18:53.280867+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:54.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:54 smithi134 bash[9858]: cluster 2021-01-28T04:18:53.281065+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-28T04:18:54.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:54 smithi134 bash[9858]: cluster 2021-01-28T04:18:53.594859+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:18:54.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:54 smithi150 bash[9867]: cluster 2021-01-28T04:18:53.098730+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v644: 212 pgs: 4 creating+peering, 12 unknown, 196 active+clean; 25 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:54.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:54 smithi150 bash[9867]: audit 2021-01-28T04:18:53.280867+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:54.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:54 smithi150 bash[9867]: cluster 2021-01-28T04:18:53.281065+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-28T04:18:54.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:54 smithi150 bash[9867]: cluster 2021-01-28T04:18:53.594859+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:18:54.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:54 smithi150 bash[13629]: cluster 2021-01-28T04:18:53.098730+0000 mgr.y (mgr.14138) 617 : cluster [DBG] pgmap v644: 212 pgs: 4 creating+peering, 12 unknown, 196 active+clean; 25 KiB data, 224 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:18:54.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:54 smithi150 bash[13629]: audit 2021-01-28T04:18:53.280867+0000 mon.a (mon.0) 1036 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:54.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:54 smithi150 bash[13629]: cluster 2021-01-28T04:18:53.281065+0000 mon.a (mon.0) 1037 : cluster [DBG] osdmap e249: 8 total, 8 up, 8 in 2021-01-28T04:18:54.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:54 smithi150 bash[13629]: cluster 2021-01-28T04:18:53.594859+0000 mon.a (mon.0) 1038 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:18:55.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:55 smithi134 bash[9858]: cluster 2021-01-28T04:18:54.302638+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-28T04:18:55.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:55 smithi150 bash[9867]: cluster 2021-01-28T04:18:54.302638+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-28T04:18:55.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:55 smithi150 bash[13629]: cluster 2021-01-28T04:18:54.302638+0000 mon.a (mon.0) 1039 : cluster [DBG] osdmap e250: 8 total, 8 up, 8 in 2021-01-28T04:18:56.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:56 smithi134 bash[9858]: cluster 2021-01-28T04:18:55.099687+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v647: 180 pgs: 180 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:56.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:56 smithi134 bash[9858]: cluster 2021-01-28T04:18:55.296802+0000 mon.a (mon.0) 1040 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:18:56.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:56 smithi134 bash[9858]: cluster 2021-01-28T04:18:55.296890+0000 mon.a (mon.0) 1041 : cluster [INF] Cluster is now healthy 2021-01-28T04:18:56.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:56 smithi134 bash[9858]: cluster 2021-01-28T04:18:55.312674+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-28T04:18:56.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:56 smithi150 bash[13629]: cluster 2021-01-28T04:18:55.099687+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v647: 180 pgs: 180 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:56.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:56 smithi150 bash[13629]: cluster 2021-01-28T04:18:55.296802+0000 mon.a (mon.0) 1040 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:18:56.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:56 smithi150 bash[13629]: cluster 2021-01-28T04:18:55.296890+0000 mon.a (mon.0) 1041 : cluster [INF] Cluster is now healthy 2021-01-28T04:18:56.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:56 smithi150 bash[13629]: cluster 2021-01-28T04:18:55.312674+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-28T04:18:56.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:56 smithi150 bash[9867]: cluster 2021-01-28T04:18:55.099687+0000 mgr.y (mgr.14138) 618 : cluster [DBG] pgmap v647: 180 pgs: 180 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:18:56.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:56 smithi150 bash[9867]: cluster 2021-01-28T04:18:55.296802+0000 mon.a (mon.0) 1040 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:18:56.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:56 smithi150 bash[9867]: cluster 2021-01-28T04:18:55.296890+0000 mon.a (mon.0) 1041 : cluster [INF] Cluster is now healthy 2021-01-28T04:18:56.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:56 smithi150 bash[9867]: cluster 2021-01-28T04:18:55.312674+0000 mon.a (mon.0) 1042 : cluster [DBG] osdmap e251: 8 total, 8 up, 8 in 2021-01-28T04:18:57.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:57 smithi134 bash[9858]: cluster 2021-01-28T04:18:56.328171+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-28T04:18:57.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:57 smithi134 bash[9858]: audit 2021-01-28T04:18:56.364941+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.150:0/3075112320' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:57.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:57 smithi134 bash[9858]: audit 2021-01-28T04:18:56.365344+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:57.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:57 smithi150 bash[13629]: cluster 2021-01-28T04:18:56.328171+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-28T04:18:57.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:57 smithi150 bash[13629]: audit 2021-01-28T04:18:56.364941+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.150:0/3075112320' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:57.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:57 smithi150 bash[13629]: audit 2021-01-28T04:18:56.365344+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:57.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:57 smithi150 bash[9867]: cluster 2021-01-28T04:18:56.328171+0000 mon.a (mon.0) 1043 : cluster [DBG] osdmap e252: 8 total, 8 up, 8 in 2021-01-28T04:18:57.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:57 smithi150 bash[9867]: audit 2021-01-28T04:18:56.364941+0000 mon.c (mon.1) 55 : audit [INF] from='client.? 172.21.15.150:0/3075112320' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:57.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:57 smithi150 bash[9867]: audit 2021-01-28T04:18:56.365344+0000 mon.a (mon.0) 1044 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:18:58.353 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_remove_omap_ramge2 ... ok 2021-01-28T04:18:58.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:58 smithi134 bash[9858]: cluster 2021-01-28T04:18:57.100719+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v650: 212 pgs: 27 unknown, 185 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:18:58.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:58 smithi134 bash[9858]: audit 2021-01-28T04:18:57.337924+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:58.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:58 smithi134 bash[9858]: cluster 2021-01-28T04:18:57.338034+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-28T04:18:58.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:58 smithi150 bash[13629]: cluster 2021-01-28T04:18:57.100719+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v650: 212 pgs: 27 unknown, 185 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:18:58.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:58 smithi150 bash[13629]: audit 2021-01-28T04:18:57.337924+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:58.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:58 smithi150 bash[13629]: cluster 2021-01-28T04:18:57.338034+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-28T04:18:58.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:58 smithi150 bash[9867]: cluster 2021-01-28T04:18:57.100719+0000 mgr.y (mgr.14138) 619 : cluster [DBG] pgmap v650: 212 pgs: 27 unknown, 185 active+clean; 25 KiB data, 229 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:18:58.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:58 smithi150 bash[9867]: audit 2021-01-28T04:18:57.337924+0000 mon.a (mon.0) 1045 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:18:58.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:58 smithi150 bash[9867]: cluster 2021-01-28T04:18:57.338034+0000 mon.a (mon.0) 1046 : cluster [DBG] osdmap e253: 8 total, 8 up, 8 in 2021-01-28T04:18:59.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:18:59 smithi134 bash[9858]: cluster 2021-01-28T04:18:58.348457+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-28T04:18:59.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:18:59 smithi150 bash[9867]: cluster 2021-01-28T04:18:58.348457+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-28T04:18:59.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:18:59 smithi150 bash[13629]: cluster 2021-01-28T04:18:58.348457+0000 mon.a (mon.0) 1047 : cluster [DBG] osdmap e254: 8 total, 8 up, 8 in 2021-01-28T04:19:00.636 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:00 smithi134 bash[9858]: cluster 2021-01-28T04:18:59.101939+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v653: 180 pgs: 180 active+clean; 25 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:00.637 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:00 smithi134 bash[9858]: cluster 2021-01-28T04:18:59.361034+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-28T04:19:00.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:00 smithi150 bash[13629]: cluster 2021-01-28T04:18:59.101939+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v653: 180 pgs: 180 active+clean; 25 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:00.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:00 smithi150 bash[13629]: cluster 2021-01-28T04:18:59.361034+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-28T04:19:00.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:00 smithi150 bash[9867]: cluster 2021-01-28T04:18:59.101939+0000 mgr.y (mgr.14138) 620 : cluster [DBG] pgmap v653: 180 pgs: 180 active+clean; 25 KiB data, 230 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:00.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:00 smithi150 bash[9867]: cluster 2021-01-28T04:18:59.361034+0000 mon.a (mon.0) 1048 : cluster [DBG] osdmap e255: 8 total, 8 up, 8 in 2021-01-28T04:19:01.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:01 smithi150 bash[13629]: cluster 2021-01-28T04:19:00.364253+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-28T04:19:01.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:01 smithi150 bash[9867]: cluster 2021-01-28T04:19:00.364253+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-28T04:19:01.767 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:01 smithi134 bash[9858]: cluster 2021-01-28T04:19:00.364253+0000 mon.a (mon.0) 1049 : cluster [DBG] osdmap e256: 8 total, 8 up, 8 in 2021-01-28T04:19:02.136 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:19:01 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:19:02.226 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:19:01 smithi150 bash[10146]: debug 2021-01-28T04:19:01.760+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:19:02.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[13629]: cluster 2021-01-28T04:19:01.102892+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v656: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:19:02.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[13629]: cluster 2021-01-28T04:19:01.387070+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-28T04:19:02.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[13629]: audit 2021-01-28T04:19:01.390412+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.150:0/2716769399' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:02.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[13629]: audit 2021-01-28T04:19:01.396021+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:02.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[13629]: audit 2021-01-28T04:19:01.765854+0000 mgr.y (mgr.14138) 622 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:19:02.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[9867]: cluster 2021-01-28T04:19:01.102892+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v656: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:19:02.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[9867]: cluster 2021-01-28T04:19:01.387070+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-28T04:19:02.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[9867]: audit 2021-01-28T04:19:01.390412+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.150:0/2716769399' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:02.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[9867]: audit 2021-01-28T04:19:01.396021+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:02.728 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:02 smithi150 bash[9867]: audit 2021-01-28T04:19:01.765854+0000 mgr.y (mgr.14138) 622 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:19:02.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:02 smithi134 bash[9858]: cluster 2021-01-28T04:19:01.102892+0000 mgr.y (mgr.14138) 621 : cluster [DBG] pgmap v656: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 231 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:19:02.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:02 smithi134 bash[9858]: cluster 2021-01-28T04:19:01.387070+0000 mon.a (mon.0) 1050 : cluster [DBG] osdmap e257: 8 total, 8 up, 8 in 2021-01-28T04:19:02.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:02 smithi134 bash[9858]: audit 2021-01-28T04:19:01.390412+0000 mon.c (mon.1) 56 : audit [INF] from='client.? 172.21.15.150:0/2716769399' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:02.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:02 smithi134 bash[9858]: audit 2021-01-28T04:19:01.396021+0000 mon.a (mon.0) 1051 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:02.888 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:02 smithi134 bash[9858]: audit 2021-01-28T04:19:01.765854+0000 mgr.y (mgr.14138) 622 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:19:03.423 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_remove_snap ... ok 2021-01-28T04:19:03.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:03 smithi150 bash[9867]: audit 2021-01-28T04:19:02.399393+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:03.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:03 smithi150 bash[9867]: cluster 2021-01-28T04:19:02.399596+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-28T04:19:03.726 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:03 smithi150 bash[13629]: audit 2021-01-28T04:19:02.399393+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:03.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:03 smithi150 bash[13629]: cluster 2021-01-28T04:19:02.399596+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-28T04:19:03.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:03 smithi134 bash[9858]: audit 2021-01-28T04:19:02.399393+0000 mon.a (mon.0) 1052 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:03.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:03 smithi134 bash[9858]: cluster 2021-01-28T04:19:02.399596+0000 mon.a (mon.0) 1053 : cluster [DBG] osdmap e258: 8 total, 8 up, 8 in 2021-01-28T04:19:04.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:04 smithi150 bash[9867]: cluster 2021-01-28T04:19:03.104231+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v659: 212 pgs: 4 creating+peering, 8 unknown, 200 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:04.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:04 smithi150 bash[9867]: cluster 2021-01-28T04:19:03.413434+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-28T04:19:04.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:04 smithi150 bash[13629]: cluster 2021-01-28T04:19:03.104231+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v659: 212 pgs: 4 creating+peering, 8 unknown, 200 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:04.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:04 smithi150 bash[13629]: cluster 2021-01-28T04:19:03.413434+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-28T04:19:04.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:04 smithi134 bash[9858]: cluster 2021-01-28T04:19:03.104231+0000 mgr.y (mgr.14138) 623 : cluster [DBG] pgmap v659: 212 pgs: 4 creating+peering, 8 unknown, 200 active+clean; 25 KiB data, 232 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:04.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:04 smithi134 bash[9858]: cluster 2021-01-28T04:19:03.413434+0000 mon.a (mon.0) 1054 : cluster [DBG] osdmap e259: 8 total, 8 up, 8 in 2021-01-28T04:19:05.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:05 smithi150 bash[9867]: cluster 2021-01-28T04:19:04.442832+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-28T04:19:05.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:05 smithi150 bash[9867]: audit 2021-01-28T04:19:04.464091+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.150:0/288489444' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:05.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:05 smithi150 bash[9867]: audit 2021-01-28T04:19:04.464466+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:05.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:05 smithi150 bash[13629]: cluster 2021-01-28T04:19:04.442832+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-28T04:19:05.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:05 smithi150 bash[13629]: audit 2021-01-28T04:19:04.464091+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.150:0/288489444' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:05.727 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:05 smithi150 bash[13629]: audit 2021-01-28T04:19:04.464466+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:05.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:05 smithi134 bash[9858]: cluster 2021-01-28T04:19:04.442832+0000 mon.a (mon.0) 1055 : cluster [DBG] osdmap e260: 8 total, 8 up, 8 in 2021-01-28T04:19:05.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:05 smithi134 bash[9858]: audit 2021-01-28T04:19:04.464091+0000 mon.c (mon.1) 57 : audit [INF] from='client.? 172.21.15.150:0/288489444' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:05.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:05 smithi134 bash[9858]: audit 2021-01-28T04:19:04.464466+0000 mon.a (mon.0) 1056 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:06.463 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_service_daemon ... ok 2021-01-28T04:19:06.726 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:06 smithi150 bash[9867]: cluster 2021-01-28T04:19:05.105275+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v662: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 236 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:06.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:06 smithi150 bash[9867]: audit 2021-01-28T04:19:05.445250+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:06.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:06 smithi150 bash[9867]: cluster 2021-01-28T04:19:05.445702+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-28T04:19:06.727 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:06 smithi150 bash[9867]: cluster 2021-01-28T04:19:06.451269+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-28T04:19:06.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:06 smithi150 bash[13629]: cluster 2021-01-28T04:19:05.105275+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v662: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 236 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:06.728 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:06 smithi150 bash[13629]: audit 2021-01-28T04:19:05.445250+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:06.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:06 smithi150 bash[13629]: cluster 2021-01-28T04:19:05.445702+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-28T04:19:06.729 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:06 smithi150 bash[13629]: cluster 2021-01-28T04:19:06.451269+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-28T04:19:06.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:06 smithi134 bash[9858]: cluster 2021-01-28T04:19:05.105275+0000 mgr.y (mgr.14138) 624 : cluster [DBG] pgmap v662: 212 pgs: 4 creating+peering, 28 unknown, 180 active+clean; 25 KiB data, 236 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:06.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:06 smithi134 bash[9858]: audit 2021-01-28T04:19:05.445250+0000 mon.a (mon.0) 1057 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:06.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:06 smithi134 bash[9858]: cluster 2021-01-28T04:19:05.445702+0000 mon.a (mon.0) 1058 : cluster [DBG] osdmap e261: 8 total, 8 up, 8 in 2021-01-28T04:19:06.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:06 smithi134 bash[9858]: cluster 2021-01-28T04:19:06.451269+0000 mon.a (mon.0) 1059 : cluster [DBG] osdmap e262: 8 total, 8 up, 8 in 2021-01-28T04:19:08.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:08 smithi134 bash[9858]: cluster 2021-01-28T04:19:07.106226+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v665: 180 pgs: 180 active+clean; 25 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:13.884 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:08 smithi134 bash[9858]: cluster 2021-01-28T04:19:07.474229+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-28T04:19:13.886 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:08 smithi150 bash[9867]: cluster 2021-01-28T04:19:07.106226+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v665: 180 pgs: 180 active+clean; 25 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:13.887 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:08 smithi150 bash[9867]: cluster 2021-01-28T04:19:07.474229+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-28T04:19:13.887 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:09 smithi150 bash[9867]: cluster 2021-01-28T04:19:08.477563+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-28T04:19:13.887 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:09 smithi150 bash[9867]: audit 2021-01-28T04:19:08.512732+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.150:0/2044083406' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:13.887 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:10 smithi150 bash[9867]: cluster 2021-01-28T04:19:09.107328+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v668: 212 pgs: 18 creating+peering, 7 unknown, 187 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:13.888 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:10 smithi150 bash[9867]: audit 2021-01-28T04:19:09.499019+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? 172.21.15.150:0/2044083406' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:13.888 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:10 smithi150 bash[9867]: cluster 2021-01-28T04:19:09.499132+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-28T04:19:13.888 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:11 smithi150 bash[9867]: cluster 2021-01-28T04:19:10.505545+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-28T04:19:13.888 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:12 smithi150 bash[9867]: cluster 2021-01-28T04:19:11.108089+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v671: 180 pgs: 180 active+clean; 25 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:19:13.888 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:12 smithi150 bash[9867]: cluster 2021-01-28T04:19:11.527908+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-28T04:19:13.889 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:12 smithi150 bash[9867]: audit 2021-01-28T04:19:11.776889+0000 mgr.y (mgr.14138) 628 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:19:13.889 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:08 smithi150 bash[13629]: cluster 2021-01-28T04:19:07.106226+0000 mgr.y (mgr.14138) 625 : cluster [DBG] pgmap v665: 180 pgs: 180 active+clean; 25 KiB data, 221 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:13.889 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:08 smithi150 bash[13629]: cluster 2021-01-28T04:19:07.474229+0000 mon.a (mon.0) 1060 : cluster [DBG] osdmap e263: 8 total, 8 up, 8 in 2021-01-28T04:19:13.889 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:09 smithi150 bash[13629]: cluster 2021-01-28T04:19:08.477563+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-28T04:19:13.890 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:09 smithi150 bash[13629]: audit 2021-01-28T04:19:08.512732+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.150:0/2044083406' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:13.890 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:10 smithi150 bash[13629]: cluster 2021-01-28T04:19:09.107328+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v668: 212 pgs: 18 creating+peering, 7 unknown, 187 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:13.890 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:10 smithi150 bash[13629]: audit 2021-01-28T04:19:09.499019+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? 172.21.15.150:0/2044083406' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:13.890 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:10 smithi150 bash[13629]: cluster 2021-01-28T04:19:09.499132+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-28T04:19:13.890 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:11 smithi150 bash[13629]: cluster 2021-01-28T04:19:10.505545+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-28T04:19:13.891 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:12 smithi150 bash[13629]: cluster 2021-01-28T04:19:11.108089+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v671: 180 pgs: 180 active+clean; 25 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:19:13.891 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:12 smithi150 bash[13629]: cluster 2021-01-28T04:19:11.527908+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-28T04:19:13.891 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:12 smithi150 bash[13629]: audit 2021-01-28T04:19:11.776889+0000 mgr.y (mgr.14138) 628 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:19:13.891 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_set_omap ... ok 2021-01-28T04:19:13.892 INFO:journalctl@ceph.mgr.y.smithi150.stdout:Jan 28 04:19:11 smithi150 bash[10146]: debug 2021-01-28T04:19:11.772+0000 7fb3b1c05700 -1 mgr.server reply reply (13) Permission denied access denied: does your client key have mgr caps? See http://docs.ceph.com/en/latest/mgr/administrator/#client-authentication 2021-01-28T04:19:13.892 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:09 smithi134 bash[9858]: cluster 2021-01-28T04:19:08.477563+0000 mon.a (mon.0) 1061 : cluster [DBG] osdmap e264: 8 total, 8 up, 8 in 2021-01-28T04:19:13.892 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:09 smithi134 bash[9858]: audit 2021-01-28T04:19:08.512732+0000 mon.a (mon.0) 1062 : audit [INF] from='client.? 172.21.15.150:0/2044083406' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:13.892 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:10 smithi134 bash[9858]: cluster 2021-01-28T04:19:09.107328+0000 mgr.y (mgr.14138) 626 : cluster [DBG] pgmap v668: 212 pgs: 18 creating+peering, 7 unknown, 187 active+clean; 25 KiB data, 222 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:13.892 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:10 smithi134 bash[9858]: audit 2021-01-28T04:19:09.499019+0000 mon.a (mon.0) 1063 : audit [INF] from='client.? 172.21.15.150:0/2044083406' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:13.893 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:10 smithi134 bash[9858]: cluster 2021-01-28T04:19:09.499132+0000 mon.a (mon.0) 1064 : cluster [DBG] osdmap e265: 8 total, 8 up, 8 in 2021-01-28T04:19:13.893 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:11 smithi134 bash[9858]: cluster 2021-01-28T04:19:10.505545+0000 mon.a (mon.0) 1065 : cluster [DBG] osdmap e266: 8 total, 8 up, 8 in 2021-01-28T04:19:13.893 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:12 smithi134 bash[9858]: cluster 2021-01-28T04:19:11.108089+0000 mgr.y (mgr.14138) 627 : cluster [DBG] pgmap v671: 180 pgs: 180 active+clean; 25 KiB data, 226 MiB used, 715 GiB / 715 GiB avail 2021-01-28T04:19:13.893 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:12 smithi134 bash[9858]: cluster 2021-01-28T04:19:11.527908+0000 mon.a (mon.0) 1066 : cluster [DBG] osdmap e267: 8 total, 8 up, 8 in 2021-01-28T04:19:13.893 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:12 smithi134 bash[9858]: audit 2021-01-28T04:19:11.776889+0000 mgr.y (mgr.14138) 628 : audit [INF] from='client.34451 -' entity='client.iscsi.iscsi.a' cmd=[{"prefix": "service status", "format": "json"}]: access denied 2021-01-28T04:19:13.894 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:13 smithi134 bash[9858]: cluster 2021-01-28T04:19:12.531082+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-28T04:19:13.894 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:13 smithi134 bash[9858]: audit 2021-01-28T04:19:12.568226+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.150:0/3667116089' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:13.894 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:13 smithi134 bash[9858]: audit 2021-01-28T04:19:12.568574+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:13.894 INFO:journalctl@ceph.iscsi.iscsi.a.smithi134.stdout:Jan 28 04:19:11 smithi134 bash[22142]: debug mgr command failed -13 2021-01-28T04:19:13.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:13 smithi150 bash[9867]: cluster 2021-01-28T04:19:12.531082+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-28T04:19:13.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:13 smithi150 bash[9867]: audit 2021-01-28T04:19:12.568226+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.150:0/3667116089' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:13.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:13 smithi150 bash[9867]: audit 2021-01-28T04:19:12.568574+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:13.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:13 smithi150 bash[13629]: cluster 2021-01-28T04:19:12.531082+0000 mon.a (mon.0) 1067 : cluster [DBG] osdmap e268: 8 total, 8 up, 8 in 2021-01-28T04:19:13.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:13 smithi150 bash[13629]: audit 2021-01-28T04:19:12.568226+0000 mon.c (mon.1) 58 : audit [INF] from='client.? 172.21.15.150:0/3667116089' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:13.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:13 smithi150 bash[13629]: audit 2021-01-28T04:19:12.568574+0000 mon.a (mon.0) 1068 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:14.574 INFO:tasks.workunit.client.0.smithi150.stderr:test_rados.TestIoctx.test_set_omap_aio ... ok 2021-01-28T04:19:14.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:14 smithi134 bash[9858]: cluster 2021-01-28T04:19:13.109427+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v674: 212 pgs: 7 creating+peering, 8 unknown, 197 active+clean; 25 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:19:14.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:14 smithi134 bash[9858]: audit 2021-01-28T04:19:13.554982+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:14.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:14 smithi134 bash[9858]: cluster 2021-01-28T04:19:13.555203+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-28T04:19:14.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:14 smithi134 bash[9858]: cluster 2021-01-28T04:19:13.601287+0000 mon.a (mon.0) 1071 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:19:14.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:14 smithi150 bash[13629]: cluster 2021-01-28T04:19:13.109427+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v674: 212 pgs: 7 creating+peering, 8 unknown, 197 active+clean; 25 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:19:14.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:14 smithi150 bash[13629]: audit 2021-01-28T04:19:13.554982+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:14.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:14 smithi150 bash[13629]: cluster 2021-01-28T04:19:13.555203+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-28T04:19:14.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:14 smithi150 bash[13629]: cluster 2021-01-28T04:19:13.601287+0000 mon.a (mon.0) 1071 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:19:14.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:14 smithi150 bash[9867]: cluster 2021-01-28T04:19:13.109427+0000 mgr.y (mgr.14138) 629 : cluster [DBG] pgmap v674: 212 pgs: 7 creating+peering, 8 unknown, 197 active+clean; 25 KiB data, 235 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 255 B/s wr, 1 op/s 2021-01-28T04:19:14.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:14 smithi150 bash[9867]: audit 2021-01-28T04:19:13.554982+0000 mon.a (mon.0) 1069 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "osd unset", "key": "noup"}]': finished 2021-01-28T04:19:14.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:14 smithi150 bash[9867]: cluster 2021-01-28T04:19:13.555203+0000 mon.a (mon.0) 1070 : cluster [DBG] osdmap e269: 8 total, 8 up, 8 in 2021-01-28T04:19:14.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:14 smithi150 bash[9867]: cluster 2021-01-28T04:19:13.601287+0000 mon.a (mon.0) 1071 : cluster [WRN] Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2021-01-28T04:19:15.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:15 smithi134 bash[9858]: cluster 2021-01-28T04:19:14.563113+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-28T04:19:15.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:15 smithi150 bash[9867]: cluster 2021-01-28T04:19:14.563113+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-28T04:19:15.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:15 smithi150 bash[13629]: cluster 2021-01-28T04:19:14.563113+0000 mon.a (mon.0) 1072 : cluster [DBG] osdmap e270: 8 total, 8 up, 8 in 2021-01-28T04:19:16.890 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:16 smithi134 bash[9858]: cluster 2021-01-28T04:19:15.110396+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v677: 180 pgs: 180 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:16.890 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:16 smithi134 bash[9858]: cluster 2021-01-28T04:19:15.575549+0000 mon.a (mon.0) 1073 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:19:16.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:16 smithi134 bash[9858]: cluster 2021-01-28T04:19:15.575627+0000 mon.a (mon.0) 1074 : cluster [INF] Cluster is now healthy 2021-01-28T04:19:16.891 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:16 smithi134 bash[9858]: cluster 2021-01-28T04:19:15.596074+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-28T04:19:16.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:16 smithi150 bash[13629]: cluster 2021-01-28T04:19:15.110396+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v677: 180 pgs: 180 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:16.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:16 smithi150 bash[13629]: cluster 2021-01-28T04:19:15.575549+0000 mon.a (mon.0) 1073 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:19:16.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:16 smithi150 bash[13629]: cluster 2021-01-28T04:19:15.575627+0000 mon.a (mon.0) 1074 : cluster [INF] Cluster is now healthy 2021-01-28T04:19:16.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:16 smithi150 bash[13629]: cluster 2021-01-28T04:19:15.596074+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-28T04:19:16.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:16 smithi150 bash[9867]: cluster 2021-01-28T04:19:15.110396+0000 mgr.y (mgr.14138) 630 : cluster [DBG] pgmap v677: 180 pgs: 180 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2021-01-28T04:19:16.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:16 smithi150 bash[9867]: cluster 2021-01-28T04:19:15.575549+0000 mon.a (mon.0) 1073 : cluster [INF] Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2021-01-28T04:19:16.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:16 smithi150 bash[9867]: cluster 2021-01-28T04:19:15.575627+0000 mon.a (mon.0) 1074 : cluster [INF] Cluster is now healthy 2021-01-28T04:19:16.978 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:16 smithi150 bash[9867]: cluster 2021-01-28T04:19:15.596074+0000 mon.a (mon.0) 1075 : cluster [DBG] osdmap e271: 8 total, 8 up, 8 in 2021-01-28T04:19:17.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:17 smithi134 bash[9858]: cluster 2021-01-28T04:19:16.602250+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-28T04:19:17.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:17 smithi150 bash[9867]: cluster 2021-01-28T04:19:16.602250+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-28T04:19:17.976 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:17 smithi150 bash[13629]: cluster 2021-01-28T04:19:16.602250+0000 mon.a (mon.0) 1076 : cluster [DBG] osdmap e272: 8 total, 8 up, 8 in 2021-01-28T04:19:18.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:18 smithi134 bash[9858]: cluster 2021-01-28T04:19:17.111392+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v680: 212 pgs: 29 unknown, 183 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:19:18.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:18 smithi134 bash[9858]: cluster 2021-01-28T04:19:17.616004+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-28T04:19:18.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:18 smithi150 bash[9867]: cluster 2021-01-28T04:19:17.111392+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v680: 212 pgs: 29 unknown, 183 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:19:18.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:18 smithi150 bash[9867]: cluster 2021-01-28T04:19:17.616004+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-28T04:19:18.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:18 smithi150 bash[13629]: cluster 2021-01-28T04:19:17.111392+0000 mgr.y (mgr.14138) 631 : cluster [DBG] pgmap v680: 212 pgs: 29 unknown, 183 active+clean; 25 KiB data, 220 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2021-01-28T04:19:18.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:18 smithi150 bash[13629]: cluster 2021-01-28T04:19:17.616004+0000 mon.a (mon.0) 1077 : cluster [DBG] osdmap e273: 8 total, 8 up, 8 in 2021-01-28T04:19:19.422 INFO:journalctl@ceph.osd.5.smithi134.stdout:Jan 28 04:19:19 smithi134 bash[15130]: debug 2021-01-28T04:19:19.145+0000 7fcda7923700 -1 osd.5 pg_epoch: 274 pg[54.10( v 273'3 (0'0,273'3] local-lis/les=271/272 n=2 ec=271/271 lis/c=271/271 les/c/f=272/272/0 sis=271) [5,2,0] r=0 lpr=271 crt=273'3 lcod 272'1 mlcod 272'1 active+clean+snaptrim trimq=[1~1]] removing snap head 2021-01-28T04:19:19.886 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:19 smithi134 bash[9858]: cluster 2021-01-28T04:19:18.624151+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-28T04:19:19.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:19 smithi134 bash[9858]: audit 2021-01-28T04:19:18.639105+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.150:0/2986245063' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:19.887 INFO:journalctl@ceph.mon.b.smithi134.stdout:Jan 28 04:19:19 smithi134 bash[9858]: audit 2021-01-28T04:19:18.639468+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:19.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:19 smithi150 bash[9867]: cluster 2021-01-28T04:19:18.624151+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-28T04:19:19.976 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:19 smithi150 bash[9867]: audit 2021-01-28T04:19:18.639105+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.150:0/2986245063' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:19.977 INFO:journalctl@ceph.mon.a.smithi150.stdout:Jan 28 04:19:19 smithi150 bash[9867]: audit 2021-01-28T04:19:18.639468+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:19.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:19 smithi150 bash[13629]: cluster 2021-01-28T04:19:18.624151+0000 mon.a (mon.0) 1078 : cluster [DBG] osdmap e274: 8 total, 8 up, 8 in 2021-01-28T04:19:19.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:19 smithi150 bash[13629]: audit 2021-01-28T04:19:18.639105+0000 mon.c (mon.1) 59 : audit [INF] from='client.? 172.21.15.150:0/2986245063' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T04:19:19.977 INFO:journalctl@ceph.mon.c.smithi150.stdout:Jan 28 04:19:19 smithi150 bash[13629]: audit 2021-01-28T04:19:18.639468+0000 mon.a (mon.0) 1079 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "osd unset", "key": "noup"}]: dispatch 2021-01-28T15:47:11.182 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2021-01-28T15:47:11.225 DEBUG:teuthology.task.console_log:Killing console logger for smithi150 2021-01-28T15:47:11.226 DEBUG:teuthology.task.console_log:Killing console logger for smithi134 2021-01-28T15:47:11.227 DEBUG:teuthology.task.console_log:Killing console logger for smithi150 2021-01-28T15:47:11.227 DEBUG:teuthology.task.console_log:Killing console logger for smithi134 2021-01-28T15:47:11.227 DEBUG:teuthology.exit:Finished running handlers